GitHub repo leaderboard by stars, growth rate and activity.

• D4Vinci

  #1D4Vinci/Scrapling

  🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

  Python79,739 starslast pushed 7 days ago
• lorien

  #2lorien/awesome-web-scraping

  List of libraries, tools and APIs for web scraping and data processing.

  JavaScript8,146 starslast pushed 3 days ago
• watercrawl

  #3watercrawl/WaterCrawl

  Transform Web Content into LLM-Ready Data

  TypeScript2,172 starslast pushed 4 weeks ago
• scrapfly

  #4scrapfly/scrapfly-scrapers

  Scalable Python web scraping scripts for +40 popular domains

  Python1,079 starslast pushed 1 week ago
• shaohua0116

  #5shaohua0116/ICLR2019-OpenReviewData

  Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.

  Jupyter Notebook388 starslast pushed 7 years ago
• MarshalX

  #6MarshalX/telegram-crawler

  🕷 Automatically detects changes to the official Telegram sites, beta clients, MTProto servers and mini apps

  Python360 starslast pushed 2 days ago
• WwwwwyDev

  #7WwwwwyDev/crawlipt

  The script for selenium in python. Make automated testing easier! 使用json脚本驱动selenium

  Python138 starslast pushed 2 years ago

#	Repo	Language	Stars	30-day trend	Last updated
1	D4Vinci D4Vinci/Scrapling 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!	Python	79,739		last pushed 7 days ago
2	lorien lorien/awesome-web-scraping List of libraries, tools and APIs for web scraping and data processing.	JavaScript	8,146		last pushed 3 days ago
3	watercrawl watercrawl/WaterCrawl Transform Web Content into LLM-Ready Data	TypeScript	2,172		last pushed 4 weeks ago
4	scrapfly scrapfly/scrapfly-scrapers Scalable Python web scraping scripts for +40 popular domains	Python	1,079		last pushed 1 week ago
5	shaohua0116 shaohua0116/ICLR2019-OpenReviewData Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.	Jupyter Notebook	388		last pushed 7 years ago
6	MarshalX MarshalX/telegram-crawler 🕷 Automatically detects changes to the official Telegram sites, beta clients, MTProto servers and mini apps	Python	360		last pushed 2 days ago
7	WwwwwyDev WwwwwyDev/crawlipt The script for selenium in python. Make automated testing easier! 使用json脚本驱动selenium	Python	138		last pushed 2 years ago

All · 11,474