GitHub repo leaderboard by stars, growth rate and activity.

• D4Vinci

  #1D4Vinci/Scrapling

  🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

  Python79,739 starslast pushed 7 days ago
• influxdata

  #2influxdata/telegraf

  Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

  Go17,798 starslast pushed Yesterday
• jhy

  #3jhy/jsoup

  jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

  Java11,389 starslast pushed Yesterday
• ssssssss-team

  #4ssssssss-team/spider-flow

  新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

  Java11,351 starslast pushed 3 years ago
• seveniruby

  #5seveniruby/AppCrawler

  基于appium的app自动遍历工具

  Scala1,237 starslast pushed 5 months ago
• benibela

  #6benibela/xidel

  Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

  Pascal843 starslast pushed 2 years ago
• lb2281075105

  #7lb2281075105/Python-Spider

  豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

  Python777 starslast pushed 4 years ago
• jpjacobpadilla

  #8jpjacobpadilla/Stealth-Requests

  Undetected web-scraping & seamless HTML parsing in Python!

  Python563 starslast pushed 5 months ago
• roniemartinez

  #9roniemartinez/dudeArchived

  dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators

  Python426 starslast pushed 1 year ago
• serpapi

  #10serpapi/nokolexbor

  High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.

  C414 starslast pushed 2 months ago

#	Repo	Language	Stars	30-day trend	Last updated
1	D4Vinci D4Vinci/Scrapling 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!	Python	79,739		last pushed 7 days ago
2	influxdata influxdata/telegraf Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.	Go	17,798		last pushed Yesterday
3	jhy jhy/jsoup jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.	Java	11,389		last pushed Yesterday
4	ssssssss-team ssssssss-team/spider-flow 新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。	Java	11,351		last pushed 3 years ago
5	seveniruby seveniruby/AppCrawler 基于appium的app自动遍历工具	Scala	1,237		last pushed 5 months ago
6	benibela benibela/xidel Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.	Pascal	843		last pushed 2 years ago
7	lb2281075105 lb2281075105/Python-Spider 豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章	Python	777		last pushed 4 years ago
8	jpjacobpadilla jpjacobpadilla/Stealth-Requests Undetected web-scraping & seamless HTML parsing in Python!	Python	563		last pushed 5 months ago
9	roniemartinez roniemartinez/dudeArchived dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators	Python	426		last pushed 1 year ago
10	serpapi serpapi/nokolexbor High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.	C	414		last pushed 2 months ago

All · 11,474