GitHub Open Source Insight
Computed at Sep 11, 2026GitHub repo leaderboard by stars, growth rate and activity.
D4Vinci
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Python79,739 starslast pushed 7 days agoscrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Python64,268 starslast pushed 2 days agoomkarcloud
The All in One Framework to Build Undefeatable Scrapers
Python5,704 starslast pushed 2 months agooxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.
Python3,389 starslast pushed 3 weeks agoThe process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
—3,256 starslast pushed 3 months agotinyfish-io
AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.
Python1,455 starslast pushed 2 weeks agoscrapfly
Scalable Python web scraping scripts for +40 popular domains
Python1,079 starslast pushed 1 week agoScrapingBee
Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML context, and automate intelligent scraper ChatGPT workflows in just a few parameters.
—943 starslast pushed 2 months agoGuide to Using Google Sheets for Basic Web Scraping
—764 starslast pushed 8 months agoAutomate scraping hotel data including pricing, availability, ratings, and booking providers with a Google Hotels API integration.
—565 starslast pushed 5 months ago
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | D4Vinci 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! | Python | 79,739 | last pushed 7 days ago | |
| 2 | scrapy Scrapy, a fast high-level web crawling & scraping framework for Python. | Python | 64,268 | last pushed 2 days ago | |
| 3 | omkarcloud The All in One Framework to Build Undefeatable Scrapers | Python | 5,704 | last pushed 2 months ago | |
| 4 | oxylabs Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering. | Python | 3,389 | last pushed 3 weeks ago | |
| 5 | oxylabs The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions. | — | 3,256 | last pushed 3 months ago | |
| 6 | tinyfish-io AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger. | Python | 1,455 | last pushed 2 weeks ago | |
| 7 | scrapfly Scalable Python web scraping scripts for +40 popular domains | Python | 1,079 | last pushed 1 week ago | |
| 8 | ScrapingBee Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML context, and automate intelligent scraper ChatGPT workflows in just a few parameters. | — | 943 | last pushed 2 months ago | |
| 9 | oxylabs Guide to Using Google Sheets for Basic Web Scraping | — | 764 | last pushed 8 months ago | |
| 10 | ScrapingBee Automate scraping hotel data including pricing, availability, ratings, and booking providers with a Google Hotels API integration. | — | 565 | last pushed 5 months ago |
All · 11,474