GitHub Open Source Insight
Computed at Sep 11, 2026GitHub repo leaderboard by stars, growth rate and activity.
firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
TypeScript178,877 starslast pushed 1 hour agoadbar
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python6,796 starslast pushed 2 weeks agoany4ai
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
TypeScript3,453 starslast pushed 2 days ago0xMassi
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Rust2,341 starslast pushed 2 days agous
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust970 starslast pushed 4 hours agolumpinif
100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.
TypeScript669 starslast pushed 3 weeks agovakra-dev
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.
TypeScript560 starslast pushed 3 weeks agoAeternaLabsHQ
Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.
JavaScript480 starslast pushed 1 week agolightfeed
Use LLMs to robustly extract web data
TypeScript320 starslast pushed 3 months agoteng-lin
Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, and multi-strategy article extraction
TypeScript308 starslast pushed 6 months ago
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | firecrawl The context API to search, scrape, and interact with the web at scale. 🔥 | TypeScript | 178,877 | last pushed 1 hour ago | |
| 2 | adbar Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML | Python | 6,796 | last pushed 2 weeks ago | |
| 3 | any4ai AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing. | TypeScript | 3,453 | last pushed 2 days ago | |
| 4 | 0xMassi Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server. | Rust | 2,341 | last pushed 2 days ago | |
| 5 | us Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud. | Rust | 970 | last pushed 4 hours ago | |
| 6 | lumpinif 100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself. | TypeScript | 669 | last pushed 3 weeks ago | |
| 7 | vakra-dev Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents. | TypeScript | 560 | last pushed 3 weeks ago | |
| 8 | AeternaLabsHQ Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links. | JavaScript | 480 | last pushed 1 week ago | |
| 9 | lightfeed Use LLMs to robustly extract web data | TypeScript | 320 | last pushed 3 months ago | |
| 10 | teng-lin Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, and multi-strategy article extraction | TypeScript | 308 | last pushed 6 months ago |
All · 11,658