GitHub repo leaderboard by stars, growth rate and activity.
The context API to search, scrape, and interact with the web at scale. 🔥
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
A collection of awesome web crawler,spider in different languages
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | The context API to search, scrape, and interact with the web at scale. 🔥 | TypeScript | 178,457 | last pushed Yesterday | |
| 2 | 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! | Python | 79,739 | last pushed 7 days ago | |
| 3 | Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees. | Python | 79,096 | last pushed 1 week ago | |
| 4 | Python scraper based on AI | Python | 30,783 | last pushed 3 days ago | |
| 5 | 🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥 | TypeScript | 17,403 | last pushed Yesterday | |
| 6 | A collection of awesome web crawler,spider in different languages | — | 7,304 | last pushed 2 years ago | |
| 7 | scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place | Go | 5,778 | last pushed 3 weeks ago | |
| 8 | Self-hosted webscraper. | TypeScript | 4,905 | last pushed 11 months ago | |
| 9 | PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs | PHP | 3,296 | last pushed Yesterday | |
| 10 | A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama | Python | 3,258 | last pushed 2 days ago |
All · 11,474