D4Vinci/Scrapling

Maintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/D4Vinci/Scrapling.svg?style=card)](https://bestofgithub.dev/repo/D4Vinci/Scrapling)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/D4Vinci/Scrapling.svg)](https://bestofgithub.dev/repo/D4Vinci/Scrapling)

Loading README…

	NodeMaven - The most efficient proxy provider for Web Scraping and Automation with the Highest Quality IP on the market. Use code SCRAPLING35 for 35% discount.
	Scrapling handles Cloudflare Turnstile. For enterprise-grade protection, Hyper Solutions provides API endpoints that generate valid antibot tokens for Akamai, DataDome, Kasada, and Incapsula. Simple API calls, no browser automation required.
	Evomi : residential proxies from $0.49/GB. Scraping browser with fully spoofed Chromium, residential IPs, auto CAPTCHA solving, and anti-bot bypass. Scraper API for hassle-free results. MCP and N8N integrations are available.
	Read a full review of Scrapling on The Web Scraping Club (Nov 2025), the #1 newsletter dedicated to Web Scraping.
	Swiftproxy provides scalable residential proxies with 80M+ IPs across 195+ countries, delivering fast, reliable connections, automatic rotation, and strong anti-block performance. Free trial available.
	Byteful supplies ethical residential, mobile, ISP, and datacenter proxies, plus scraping and AI automation tools. Use code SCRAPLING10: 10% off residential proxies.
	ProxyLane: 90% fewer CAPTCHAs on your Scrapling runs. 28M real P2P residential devices, 98.7% clean IPs, 195 countries. City/ISP/ZIP targeting, sticky/rotating sessions, traffic never expires. Try 350 MB for $1.95. Code SCRAPEANDTAKE: 25% off.
	LundProxy: Stop paying per GB. Unlimited residential traffic, 100M+ IPs, 190+ countries. Pay by bandwidth. Request a free 50 Mbps residential proxies trial.
	Resolvr: Scraping at scale means CAPTCHAs at scale. Resolvr solves reCAPTCHA and Cloudflare challenges on real devices through one API. Free beta access is available now.
	$1/GB at DataImpulse. Ethical first-party proxies. 90M+ IPs, 195+ countries. Residential, datacenter, mobile. Pay-as-you-go = no subscription. Traffic never expires.

#	Library	Time (ms)	vs Scrapling
1	Scrapling	1.99	1.0x
2	Parsel/Scrapy	2.06	1.035
3	Raw Lxml	2.56	1.286
4	PyQuery	23.98	~12x
5	Selectolax	197.02	~99x
6	MechanicalSoup	1545.15	~776.5x
7	BS4 with Lxml	1562.1	~785.0x
8	BS4 with html5lib	3412.73	~1714.9x

Library	Time (ms)	vs Scrapling
Scrapling	2.3	1.0x
AutoScraper	12.58	5.47x

D4Vinci/Scrapling

Effortless Web Scraping for the Modern Web

What you can do with Scrapling

Platinum Sponsors

Sponsors

Key Features

Spiders - A Full Crawling Framework

Advanced Websites Fetching with Session Support

Parsing and Data Extraction

AI Features

High-Performance & battle-tested Architecture

Developer/Web Scraper Friendly Experience

Getting Started

Basic Usage

Spiders

Advanced Parsing & Navigation

Async Session Management Examples

CLI & Interactive Shell

Performance Benchmarks

Text Extraction Speed Test (5000 nested elements)

Element Similarity & Text Search Performance

Installation

Optional Dependencies

Docker

Contributing

Disclaimer

🎓 Citations

License

Acknowledgments