GitHub repo leaderboard by stars, growth rate and activity.
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Readability / Html Content / Article Extractor & Web Scrapping library written in PHP
Use LLMs to robustly extract web data
MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML | Python | 6,796 | last pushed 2 weeks ago | |
| 2 | Readability / Html Content / Article Extractor & Web Scrapping library written in PHP | PHP | 461 | last pushed 3 years ago | |
| 3 | Use LLMs to robustly extract web data | TypeScript | 320 | last pushed 3 months ago | |
| 4 | MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation. | Python | 288 | last pushed 6 months ago |
All · 11,658