aiagent.club
中文
GitHub repo

unclecode/crawl4ai

Python Tracked since 2024-05-09 Updated 2026-09-12 View source ↗

#18 of 803 by Stars among GitHub repos

82.2k Stars

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

About

Reliable, large-scale web extraction, now built to be drastically more cost-effective than any of the existing solutions.

👉 Apply here for early access We’ll be onboarding in phases and working closely with early users. Limited slots.

Crawl4AI turns the web into clean, LLM ready Markdown for RAG, agents, and data pipelines. Fast, controllable, battle tested by a 50k+ star community.

✨ New in v0.9.2: Maintenance patch release. Fixes a MemoryAdaptiveDispatcher task/page leak when a streaming crawl is closed, Docker Playground "Advanced Config" and Monitor WebSocket auth, Playwright headless-shell packaging, and GPU (ENABLEGPU=true) Docker builds. Release notes →

✨ Recent v0.9.0: Major…

Excerpted from github.com/unclecode/crawl4ai

Latest metrics

Stars 82.2k 2026-09-12
Forks 8.5k 2026-09-12
Commits 1.7k 2026-09-12
Releases 21 2026-09-12
Watchers 413 2026-09-12
Open issues 41 2026-09-12
Open PRs 152 2026-09-12