unclecode/crawl4ai

LLM-ready output: smart Markdown with headings, tables, code and citation hints
Fast in practice: async browser pool, caching, minimal hops
Full control: sessions, proxies, cookies, user scripts, hooks
Adaptive intelligence: learns site patterns, explores only what matters
Deploy anywhere: no keys needed, CLI and Docker, or the hosted cloud

Maintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/unclecode/crawl4ai.svg?style=card)](https://bestofgithub.dev/repo/unclecode/crawl4ai)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/unclecode/crawl4ai.svg)](https://bestofgithub.dev/repo/unclecode/crawl4ai)

Loading README…

	🐍 Library	🐳 Your own server	☁️ Crawl4AI Cloud
Runs the browsers	you, in your Python process	you, in Docker on your machine	we do
JS-heavy pages and bot walls	your settings, your proxies	your settings, your proxies	handled for you, automatically
Web search	–	–	`/search`, `/serp` and `/answer`
Price	free, forever	free (your hosting)	1,000 free credits a month; plans from $10

Company	About	Sponsorship Tier
	Helps engineers and buyers find, compare, and source electronic & industrial parts in seconds, with specs, pricing, lead times & alternatives.	🥇 Gold
	Kidocode is a hybrid technology and entrepreneurship school for kids aged 5–18, offering both online and on-campus education.	🥇 Gold
	Singapore-based Aleph Null is Asia’s leading edtech hub, dedicated to student-centric, AI-driven education—empowering learners with the tools to thrive in a fast-changing world.	🥇 Gold

🚀🤖 Crawl4AI: the open-source web crawler for LLMs and AI agents