Website Content Crawler
By Apify · Free · ApifyIntel score 85/100
Published 2023-03-27 · Last updated 2026-10-07
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
Key stats
- 44.9M total runs
- 166.5K total users
- 4.62 Apify Store rating (234 reviews)
- 2.7K bookmarks
Try Website Content Crawler on Apify
How Website Content Crawler has moved
ApifyIntel has recorded Website Content Crawler in 276 daily snapshots of the Apify Store since 2025-11-21. Latest reading: 2026-10-08.
- 13,880 monthly users, up 32% from 10,533 on 2026-09-08, up 70% from 8,147 on 2026-07-10
- 2.9M runs in the last 30 days, 96.4% of them succeeded (30 days earlier: 3.1M runs, 96.6% succeeded)
- 2.9M runs added to the lifetime total since 2026-09-08 (now 44.9M)
- Ranked #12 of 72,628 actors by monthly users, down 1 place since 2026-09-08
- Apify Store rating 4.62 from 234 reviews (4.61 from 211 on 2026-07-10)
Alternatives to Website Content Crawler
Actors sharing the most Apify Store categories with Website Content Crawler, then closest to its 13,880 monthly users.
- Web Fetch: 17,196 monthly users (1.2× Website Content Crawler), pay per event, rated 5.0 on the Apify Store
- YouTube Transcript & Subtitles Scraper API: 2,183 monthly users (16% of Website Content Crawler), pay per event, rated 4.5 on the Apify Store
- Keyword Search Volume — Bulk Google Metrics (CPC & Trend): 746 monthly users (5% of Website Content Crawler), pay per event
- YouTube Transcript Ninja ⚡️🥷⚡: 380 monthly users (3% of Website Content Crawler), pay per event, rated 5.0 on the Apify Store
- Instagram Reels Scraper from any keyword - No Login - No cookie: 367 monthly users (3% of Website Content Crawler), pay per event, rated 4.2 on the Apify Store
- Shopee Scraper: 285 monthly users (2% of Website Content Crawler), pay per event, rated 4.3 on the Apify Store