GitHub repo leaderboard by stars, growth rate and activity.

• apache

  #1apache/stormcrawler

  A scalable, mature and versatile web crawler based on Apache Storm

  Java995 starslast pushed 12 hours ago
• commoncrawl

  #2commoncrawl/news-crawl

  News crawling with StormCrawler - stores content as WARC

  Java375 starslast pushed 3 days ago

#	Repo	Language	Stars	30-day trend	Last updated
1	apache apache/stormcrawler A scalable, mature and versatile web crawler based on Apache Storm	Java	995		last pushed 12 hours ago
2	commoncrawl commoncrawl/news-crawl News crawling with StormCrawler - stores content as WARC	Java	375		last pushed 3 days ago

All · 11,658