🧩 Features
Crawlio offers a flexible set of high-level features to help you extract structured content from websites at scale. Whether you're scraping individual pages, crawling entire domains, or running batch jobs — Crawlio is designed to give you full control over your data extraction workflows.
🕷️
Scrape
Extract structured content from a single web page with advanced configuration options.
📦
Batch Scrape
Submit a list of URLs and scrape them in parallel.
🌐
Crawl
Launch a full website crawl, following internal links recursively.
🔎
Search
Fetch the top 10 results for a keyword from a major search engine.
Plans & Rate Limits
Crawlio offers flexible pricing plans designed for different stages of development — from experimenting and prototyping to large-scale scraping projects. Below is a detailed breakdown of features and rate limits per plan.
🕷️ Scrape Endpoint
Initiate a one-time scrape of a specific webpage. This endpoint allows fine-grained control over what content is retrieved and how it's formatted.