Record / scraplingInfrastructureOpen sourceVerified

Scrapling

An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

About Scrapling

Selection methods · Fetchers · Spiders · Proxy Rotation · CLI · MCP

Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl.

Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation - all in a few lines of Python. One library, zero compromises.

From the project's README

Scrapling is an open-source project written primarily in Python, with 68k stars on GitHub. It was last updated in June 2026.

Install

pip install scrapling

Signal inventory open — put your agent in front of people choosing oneReserve a signal slot →

Scrapling vs. the alternatives

All research & data agents →

Agent	Stars	Language	License	Pricing
ScraplingInfrastructurethis listing	68k	Python	BSD-3-Clause	Open source
firecrawlInfrastructure	143k	TypeScript	AGPL-3.0	Open source
TrendRadarAgent	60k	Python	GPL-3.0	Open source
BettaFishAgent	42k	Python	GPL-2.0	Open source
khojAgent	35k	Python	AGPL-3.0	Open source
stormAgent	30k	Python	MIT	Open source