# Scrapling

> Scrapling is a BSD-3-Clause Python library (3.10+) with HTTP and browser fetchers, Scrapy-like spiders with pause/resume and optional robots.txt obeying, selectors that relocate elements after site changes, an MCP server and site-to-Markdown spiders for RAG. A main selling point is stealth fetching that the README says bypasses anti-bot systems such as Cloudflare Turnstile. Caution: users must respect site terms and robots.txt; the README itself says the library is for educational and research purposes.

- Repository: https://github.com/D4Vinci/Scrapling
- Official docs: https://scrapling.readthedocs.io/en/latest/
- Checked: 2026-10-16

## What it replaces
- Firecrawl Cloud: Crawl a site to Markdown, Scrape pages (JS-heavy and bot-protected) (partial). A library you code against, not a hosted API; no built-in LLM extraction or web search.

## Facts, with sources

| Question | Status | Answer | Source | Checked |
|---|---|---|---|---|
| Runs on my machine? | Confirmed | Yes, Python library on your machine; Docker image also published | https://github.com/D4Vinci/Scrapling#readme | 2026-10-15 |
| Code licence | Confirmed | BSD-3-Clause | https://github.com/D4Vinci/Scrapling/blob/main/LICENSE | 2026-10-15 |
| Model weights licence | Confirmed | No separate model weights | https://github.com/D4Vinci/Scrapling#readme | 2026-10-15 |
| Commercial use | Confirmed | Yes, BSD-3-Clause; README disclaimer frames it as for educational and research purposes | https://github.com/D4Vinci/Scrapling#disclaimer | 2026-10-15 |
| Paid services needed? | Confirmed | None required; proxies optional | https://github.com/D4Vinci/Scrapling#readme | 2026-10-15 |
| Hardware | Unknown | Not documented; browser fetchers run Chromium | https://github.com/D4Vinci/Scrapling#readme | 2026-10-15 |
| Operating systems | Confirmed | Spider documentation explicitly covers Linux/macOS (uvloop) and Windows (winloop) for the optional accelerated event loop; individual browser-fetcher dependencies still need installation | https://scrapling.readthedocs.io/en/latest/spiders/advanced.html#using-uvloop | 2026-10-16 |
| Setup effort | Confirmed | Easy, pip install scrapling; browser fetchers need the fetchers extra and scrapling install | https://github.com/D4Vinci/Scrapling#installation | 2026-10-15 |

GitHub: 87995 stars, 9045 forks, last push 2026-10-16, archived: no.
---
Source: RepoQuarry (https://repoquarry.dev/projects/scrapling). Data licence: CC BY 4.0. Quotes are from project documentation and belong to their authors.