GitHub Open Source Insight
Computed at Sep 11, 2026GitHub repo leaderboard by stars, growth rate and activity.
projectdiscovery
A next-generation crawling and spidering framework.
Go17,438 starslast pushed Yesterdayssssssss-team
xianhu
spidersuite
SpiderSuite (web security crawler) releases, wiki and roadmap
—976 starslast pushed 4 weeks agopostmodern
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Ruby836 starslast pushed 8 months agoVIDA-NYU
rivermont
The simple, easy to use command line web crawler.
Python354 starslast pushed 2 years agos0rg
infinilabs
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
Go311 starslast pushed 5 years ago
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | projectdiscovery A next-generation crawling and spidering framework. | Go | 17,438 | last pushed Yesterday | |
| 2 | ssssssss-team 新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。 | Java | 11,351 | last pushed 3 years ago | |
| 3 | xianhu 简单易用的Python爬虫框架，QQ交流群：597510560 | Python | 1,834 | last pushed 4 years ago | |
| 4 | spidersuite SpiderSuite (web security crawler) releases, wiki and roadmap | — | 976 | last pushed 4 weeks ago | |
| 5 | postmodern A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use. | Ruby | 836 | last pushed 8 months ago | |
| 6 | VIDA-NYU ACHE is a web crawler for domain-specific search. | Java | 488 | last pushed 1 year ago | |
| 7 | rivermont The simple, easy to use command line web crawler. | Python | 354 | last pushed 2 years ago | |
| 8 | s0rg The unix-way web crawler | Go | 340 | last pushed 3 weeks ago | |
| 9 | infinilabs 🕷️ An easy-to-use spider written in Golang. (previous named GOPA.) | Go | 311 | last pushed 5 years ago |
All · 11,474