GitHub repo leaderboard by stars, growth rate and activity.

• adbar

  #1adbar/trafilatura

  Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

  Python6,796 starslast pushed 2 weeks ago
• flairNLP

  #2flairNLP/fundus

  A very simple news crawler with a funny name

  Python474 starslast pushed 2 days ago
• bitextor

  #3bitextor/bitextor

  Bitextor generates translation memories from multilingual websites

  Python300 starslast pushed 2 years ago
• opendatalab

  #4opendatalab/MinerU-HTML

  MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.

  Python288 starslast pushed 6 months ago

#	Repo	Language	Stars	30-day trend	Last updated
1	adbar adbar/trafilatura Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML	Python	6,796		last pushed 2 weeks ago
2	flairNLP flairNLP/fundus A very simple news crawler with a funny name	Python	474		last pushed 2 days ago
3	bitextor bitextor/bitextor Bitextor generates translation memories from multilingual websites	Python	300		last pushed 2 years ago
4	opendatalab opendatalab/MinerU-HTML MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.	Python	288		last pushed 6 months ago

All · 11,658