GitHub repo leaderboard by stars, growth rate and activity.

• crawlab-team

  #1crawlab-team/crawlab

  Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

  Go12,270 starslast pushed 7 months ago
• lining0806

  #2lining0806/PythonSpiderNotes

  Python入门网络爬虫之精华版

  Python7,463 starslast pushed 5 years ago
• chyroc

  #3chyroc/WechatSogou

  基于搜狗微信搜索的微信公众号爬虫接口

  Python6,380 starslast pushed 6 months ago
• DropsDevopsOrg

  #4DropsDevopsOrg/ECommerceCrawlers

  实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼、阿里任务、博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛泛目录、今日头条、豆瓣影评、携程、小米应用商店、安居客、途家民宿❤️❤️❤️。微信爬虫展示项目:

  Python5,676 starslast pushed 2 years ago
• rmax

  #5rmax/scrapy-redis

  Redis-based components for Scrapy.

  Python5,643 starslast pushed 4 days ago
• SpiderClub

  #6SpiderClub/haipproxy

  :sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis

  Python5,521 starslast pushed 4 years ago
• Boris-code

  #7Boris-code/feapder

  🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度

  Python3,736 starslast pushed 3 weeks ago
• wkunzhi

  #8wkunzhi/Python3-Spider

  Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

  Python3,386 starslast pushed 3 years ago
• TheWebScrapingClub

  #9TheWebScrapingClub/webscraping-from-0-to-hero

  The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

  —1,737 starslast pushed 2 years ago
• eliasdabbas

  #10eliasdabbas/advertools

  advertools - online marketing productivity and analysis tools

  Python1,452 starslast pushed 2 months ago

#	Repo	Language	Stars	30-day trend	Last updated
1	crawlab-team crawlab-team/crawlab Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架	Go	12,270		last pushed 7 months ago
2	lining0806 lining0806/PythonSpiderNotes Python入门网络爬虫之精华版	Python	7,463		last pushed 5 years ago
3	chyroc chyroc/WechatSogou 基于搜狗微信搜索的微信公众号爬虫接口	Python	6,380		last pushed 6 months ago
4	DropsDevopsOrg DropsDevopsOrg/ECommerceCrawlers 实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼、阿里任务、博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛泛目录、今日头条、豆瓣影评、携程、小米应用商店、安居客、途家民宿❤️❤️❤️。微信爬虫展示项目:	Python	5,676		last pushed 2 years ago
5	rmax rmax/scrapy-redis Redis-based components for Scrapy.	Python	5,643		last pushed 4 days ago
6	SpiderClub SpiderClub/haipproxy :sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis	Python	5,521		last pushed 4 years ago
7	Boris-code Boris-code/feapder 🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度	Python	3,736		last pushed 3 weeks ago
8	wkunzhi wkunzhi/Python3-Spider Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️	Python	3,386		last pushed 3 years ago
9	TheWebScrapingClub TheWebScrapingClub/webscraping-from-0-to-hero The web scraping open project repository aims to share knowledge and experiences about web scraping with Python	—	1,737		last pushed 2 years ago
10	eliasdabbas eliasdabbas/advertools advertools - online marketing productivity and analysis tools	Python	1,452		last pushed 2 months ago

All · 11,474