GitHub repo leaderboard by stars, growth rate and activity.
news-please - an integrated web crawler and information extractor for news that just works
NewPipe's core library for extracting data from streaming sites
SEO & Security Audit for Websites. Lighthouse & Security Headers crawler, Sitemap/Keywords/Images Extractor, Summarizer, etc ...
Crawl and extract (regular or onion) webpages through TOR network
A framework for creating semi-automatic web content extractors
crawler framework, distributed crawler extractor
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | news-please - an integrated web crawler and information extractor for news that just works | Python | 2,487 | last pushed 5 months ago | |
| 2 | NewPipe's core library for extracting data from streaming sites | Java | 1,966 | last pushed 7 days ago | |
| 3 | SEO & Security Audit for Websites. Lighthouse & Security Headers crawler, Sitemap/Keywords/Images Extractor, Summarizer, etc ... | Python | 814 | last pushed 4 years ago | |
| 4 | Crawl and extract (regular or onion) webpages through TOR network | Python | 534 | last pushed 2 months ago | |
| 5 | A framework for creating semi-automatic web content extractors | Python | 504 | last pushed 8 months ago | |
| 6 | crawler framework, distributed crawler extractor | C# | 264 | last pushed 2 years ago |
All · 11,474