GitHub Open Source Insight
Computed at Sep 11, 2026GitHub repo leaderboard by stars, growth rate and activity.
firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
TypeScript178,457 starslast pushed YesterdayD4Vinci
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Python79,739 starslast pushed 7 days agoScrapeGraphAI
any4ai
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
TypeScript3,452 starslast pushed 2 days agooxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.
Python3,389 starslast pushed 3 weeks agoitsOwen
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
Python3,258 starslast pushed 2 days ago0xMassi
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Rust2,339 starslast pushed 2 days agoraznem
Lightweight library for scraping web-sites with LLMs
Python1,356 starslast pushed 9 months agoAI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with unmatched precision. Ideal for scalable AI scraping tasks across diverse web sources, this tool simplifies complex scraping operations into efficient, intelligent workflows.
—1,090 starslast pushed 5 months agoStructured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio JS SDK for intelligent web data gathering.
TypeScript417 starslast pushed 3 weeks ago
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | firecrawl The context API to search, scrape, and interact with the web at scale. 🔥 | TypeScript | 178,457 | last pushed Yesterday | |
| 2 | D4Vinci 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! | Python | 79,739 | last pushed 7 days ago | |
| 3 | ScrapeGraphAI Python scraper based on AI | Python | 30,783 | last pushed 4 days ago | |
| 4 | any4ai AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing. | TypeScript | 3,452 | last pushed 2 days ago | |
| 5 | oxylabs Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering. | Python | 3,389 | last pushed 3 weeks ago | |
| 6 | itsOwen A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama | Python | 3,258 | last pushed 2 days ago | |
| 7 | 0xMassi Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server. | Rust | 2,339 | last pushed 2 days ago | |
| 8 | raznem Lightweight library for scraping web-sites with LLMs | Python | 1,356 | last pushed 9 months ago | |
| 9 | oxylabs AI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with unmatched precision. Ideal for scalable AI scraping tasks across diverse web sources, this tool simplifies complex scraping operations into efficient, intelligent workflows. | — | 1,090 | last pushed 5 months ago | |
| 10 | oxylabs Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio JS SDK for intelligent web data gathering. | TypeScript | 417 | last pushed 3 weeks ago |
All · 11,474