Crawl4AI
unclecode/crawl4ai BEST FIT Actively maintained: 100+ people committing, active 12 of the last 12 weeks.Open-source Python web crawler that turns pages into clean, LLM-ready Markdown or structured JSON, as a library, CLI or Docker server.
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · Apache-2.0
- Paid services
- Confirmed: None required
- Hardware
- Unknown: Unknown
- Setup
- Confirmed: Easy