Website Content Crawler
By Apify · Free · ApifyIntel score 85/100
Published 2023-03-27 · Last updated 2026-11-18
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
Key stats
- 50.3M total runs
- 179.2K total users
- 4.59 Apify Store rating (235 reviews)
- 2.7K bookmarks
Try Website Content Crawler on Apify
How Website Content Crawler has moved
ApifyIntel has recorded Website Content Crawler in 316 daily snapshots of the Apify Store since 2025-11-21. Latest reading: 2026-11-19.
- 12,119 monthly users, down 8.8% from 13,285 on 2026-10-20, up 25% from 9,684 on 2026-08-21
- 3.8M runs in the last 30 days, 96.5% of them succeeded (30 days earlier: 3.2M runs, 96.3% succeeded)
- 3.9M runs added to the lifetime total since 2026-10-20 (now 50.3M)
- Ranked #17 of 98,709 actors by monthly users, down 2 places since 2026-10-20
- Apify Store rating 4.59 from 235 reviews (4.58 from 223 on 2026-08-21)
Related actors for Website Content Crawler
Actors sharing the most Apify Store categories with Website Content Crawler, then closest to its 12,119 monthly users.
- YouTube Transcript & Subtitles Scraper API: 7,207 monthly users (59% of Website Content Crawler), pay per event, rated 4.8 on the Apify Store
- Web Fetch: 33,846 monthly users (2.8× Website Content Crawler), pay per event, rated 5.0 on the Apify Store
- Keyword Search Volume — Bulk Google Metrics (CPC & Trend): 1,011 monthly users (8% of Website Content Crawler), pay per event
- Instagram Reels Scraper from any keyword - No Login - No cookie: 469 monthly users (4% of Website Content Crawler), pay per event, rated 4.2 on the Apify Store
- Shopee Scraper: 302 monthly users (2% of Website Content Crawler), pay per event, rated 4.3 on the Apify Store
- YouTube Transcript Ninja ⚡️🥷⚡: 290 monthly users (2% of Website Content Crawler), pay per event, rated 5.0 on the Apify Store