Best Python Web Scraping Frameworks on GitHub (2026)

Q: What is the best python web scraping frameworks on GitHub?

Based on the RepoRadar scoring engine, scrapy/scrapy is currently the top-ranked python web scraping frameworks with 62.3k stars and a score of 95/100.

Q: When was this python web scraping frameworks list last updated?

This list was last updated on 2026-06-19. Data is sourced directly from GitHub's public API.

This list contains the top 9 python web scraping frameworks on GitHub, ranked by the RepoRadar scoring engine across five quality dimensions. The top-ranked repo is scrapy/scrapy with 62.3k stars. Projects span written in Python, Go. Data last updated 2026-06-19.

Updated 2026-06-19 · 9 repos · Data: GitHub public API

Refine live →

Scrapy, a fast high-level web crawling & scraping framework for Python.

★62.3k ⑂ 11,663 ⚠ 619 Python updated 2 days ago

crawlercrawlingframeworkhacktoberfest

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

★64.8k ⑂ 6,371 ⚠ 10 Python updated yesterday

aiai-scrapingautomationcrawler

SeleniumBase is a framework for UI Testing, Web Scraping, and Stealth. Passes every bot-detection test with CDP Mode, and extends Playwright.

★12.8k ⑂ 1,568 ⚠ 15 Python updated 20 hours ago

anti-detectionbot-detectionchromedriverchromium

All Results

Enterprise-grade multi-language web scraping framework (Java/Go/Rust/Python) with complete capabilities

★218 ⑂ 38 ⚠ 4 updated 7 days ago

GoScrapy: Harnessing Go's perfomance for blazingly fast web scraping, inspired by Python's Scrapy framework.

★352 ⑂ 38 ⚠ 0 Go updated 1 month ago

data-extractiongo-scrapygolanggoscraper

Web Scraping Framework

★2.5k ⑂ 276 ⚠ 1 Python updated 8 months ago

asynchronouscrawlercrawlingframework

A framework for creating semi-automatic web content extractors

★502 ⑂ 41 ⚠ 22 Python updated 5 months ago

beautifulsoupcrawlercss-selectorextractor

Async Python 3.6+ web scraping micro-framework based on asyncio

★1.7k ⑂ 186 ⚠ 9 Python updated 2 years ago

aiohttpasyncioasyncio-spidercrawler

Python web scraping framework

★310 ⑂ 65 ⚠ 2 Python updated 8 years ago

Frequently Asked Questions

What is the best python web scraping frameworks on GitHub?

Based on the RepoRadar scoring engine, scrapy/scrapy is currently the top-ranked option with 62.3k stars and a score of 95/100.

How are python web scraping frameworks repositories ranked?

Repositories are ranked by the RepoRadar score — a composite of five dimensions: Popularity (35%), Freshness (25%), Maintenance (20%), Community (10%), and Completeness (10%). Scores range from 0–100.

When was this list last updated?

This list was last updated on 2026-06-19. Data is sourced directly from GitHub's public API. No cached or fabricated repositories are used.

→Open Source Bi Tools →React Table Libraries →Llm Agent Frameworks →Python Web Frameworks