Plans & Rate Limits
Crawlio offers flexible pricing plans designed for different stages of development — from experimenting and prototyping to large-scale scraping projects. Below is a detailed breakdown of features and rate limits per plan.
🟢 Community Plan — FREE
Best for: Testing, personal projects, or early-stage prototypes
Price: FREE
Key Features:
- 🕷️ Scrape 1,000 pages
- 🤖 10 requests per minute
- 🏃♀️ 3 Crawls (each crawl consumes scrape credits)
- 📃 Unlimited Search Engine Results (limited by available scrape credits)
- 🎧 Discord support
Rate Limits:
| Feature | Limit |
|---|---|
scrape | 1,000 total / 10 RPM |
crawl | 3 total / 1 RPM |
concurrent-batch | 1 |
batch-max-url | 100 URLs per batch |
🔵 Web Surfer Plan — $14/month
Best for: Small teams or hobbyist scraping
Key Features:
- 🕷️ Scrape 10,000 pages
- 🤖 40 requests per minute
- 🏃♀️ Unlimited Crawls (limited by available scrape credits)
- 📃 Unlimited Search Engine Results (limited by available scrape credits)
- 🎧 Priority Discord support
Rate Limits:
| Feature | Limit |
|---|---|
scrape | 10,000 total / 40 RPM |
crawl | 10,000 total / 1 RPM |
concurrent-crawl | 4 |
concurrent-batch | 3 |
batch-max-url | 500 URLs per batch |
🟠 Pro Plan — $35/month
Best for: AI startups, data teams
Key Features:
- 🕷️ Scrape 50,000 pages
- 🤖 120 requests per minute
- 🏃♀️ Unlimited Crawls (limited by available scrape credits)
- 📃 Unlimited Search Engine Results (limited by available scrape credits)
- 🎧 Priority Discord support
Rate Limits:
| Feature | Limit |
|---|---|
scrape | 50,000 total / 120 RPM |
crawl | 50,000 total / 120 RPM |
concurrent-crawl | 5 |
concurrent-batch | 4 |
batch-max-url | 700 URLs per batch |
🔴 Business Plan — $55/month
Best for: Large-scale data operations & enterprises
Key Features:
- 🕷️ Scrape 250,000 pages
- 🤖 180 requests per minute
- 🏃♀️ Unlimited Crawls (limited by available scrape credits)
- 📃 Unlimited Search Engine Results (limited by available scrape credits)
- 🎧 Priority Discord support
Rate Limits:
| Feature | Limit |
|---|---|
scrape | 250,000 total / 180 RPM |
crawl | 250,000 total |
concurrent-crawl | 6 |
concurrent-batch | 5 |
batch-max-url | 1,000 URLs per batch |
Quickstart
Get up and running with Crawlio in minutes. Follow these steps to start your first web scraping job using the SDK of your choice or directly through the REST API.
🧩 Features
Crawlio offers a flexible set of high-level features to help you extract structured content from websites at scale. Whether you're scraping individual pages, crawling entire domains, or running batch jobs — Crawlio is designed to give you full control over your data extraction workflows.