Skip to content
RepoQuarry

Crawl4AI unclecode/crawl4ai

Open-source Python web crawler that turns pages into clean, LLM-ready Markdown or structured JSON, as a library, CLI or Docker server.

Crawl4AI at a glance

Checked 16 Oct 2026

Crawl4AI (v0.9.5, October 2026) is a Python library, CLI and Docker server that drives a headless browser to crawl sites into Markdown with content filters and citations, and extracts JSON with CSS/XPath schemas (no LLM) or any LiteLLM provider, including Ollama. It has proxy, session and stealth options. Licence is Apache-2.0 with an added attribution requirement in the LICENSE file. A paid Crawl4AI Cloud adds web search and managed bot handling. Users must respect site terms and robots.txt.

Cite this pageRepoQuarry. “Crawl4AI.” Checked 16 Oct 2026. https://repoquarry.dev/projects/crawl4ai

How much of Firecrawl Cloud does it replace?

3 of 4 jobs. You run the browsers and supply any proxies yourself; no built-in web search in the open-source version.

Partial: Crawl a site to Markdown Partial replacement
Partial: Scrape pages (JS-heavy and bot-protected) Partial replacement
Partial: Structured data extraction Partial replacement
No: Web search with page content Not covered

For web search with page content, see other Firecrawl Cloud alternatives. You may also need to build an interface, an API server and hosting yourself.

Facts, with sources

Every answer links to where we found it. We read the documentation; we did not install it.

Report a correction
QuestionAnswerSourceChecked
Runs on my machine? Confirmed: Yes, in your Python process or a Docker server on your machine Run the open-source web crawler and scraper yourself, free forever, or use it hosted with one key github.com · crawl4ai#which-one ↗ 1d ago
Code licence Partial: Apache-2.0 plus an added attribution requirement All distributions, publications, or public uses of this software, or derivative works based on this software, must include the following attribution github.com · LICENSE ↗ 1d ago
Model weights licence Confirmed: No separate model weights; LLM extraction uses the provider you connect github.com · crawl4ai#readme ↗ 1d ago
Commercial use Partial: Yes, with the attribution required by the LICENSE file This attribution must be displayed in a prominent and easily accessible location github.com · LICENSE ↗ 1d ago
Paid services needed? Confirmed: None required; LLM extraction optional (local Ollama or paid APIs), Crawl4AI Cloud optional no keys needed, CLI and Docker, or the hosted cloud github.com · crawl4ai#which-one ↗ 1d ago
Hardware Unknown: Not documented; runs a headless browser github.com · crawl4ai#readme ↗ 1d ago
Operating systems Partial: Official installation guide includes Ubuntu-specific Playwright dependency instructions; Windows and macOS support are not confirmed in the reviewed installation pages docs.crawl4ai.com · installation ↗ today
Setup effort Confirmed: Easy, pip install crawl4ai then crawl4ai-setup to install the browser pip install -U crawl4ai github.com · crawl4ai#readme ↗ 1d ago

Get the weekly top 5 and what’s new, every Monday

We’ll email you once a week. Unsubscribe any time. We never share your email.

Cookie preferences

Choose what we may store in your browser. You can change this any time from Cookie settings in the footer.

Essential

Security, and remembering this choice. rq-consent · 12 months

Always on