Catalog / Open web & SEO data
Crawl a website and extract its pages
5 providers do this through one treg key: AnyAPI, Firecrawl, Olostep, ScrapeGraphAI, Tavily.
- AnyAPI Crawl a website and get clean text content from up to 10 pages in one normalized response, ideal for feeding sites into LLMs and search indexes.$0.00495/success · anyapi.web.crawl
- Firecrawl Start a bounded crawl and pay for pages processed.$0.005-$0.05/success · firecrawl.web.crawl
- Olostep Start a bounded asynchronous website crawl and pay only for completed pages.$0.002-$0.2/success · olostep.web.crawl
- ScrapeGraphAI Start a bounded one-page Markdown crawl and return its job id.$0.012/success · scrapegraphai.web.crawl
- Tavily Map a website and extract clean content from the discovered pages in one request.$0.0024-$0.0048/success · tavily.web.crawl