GitHub repo leaderboard by stars, growth rate and activity.
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
全自动短视频搬运工具,支持自动下载、去重、AI生成标题+标签、上传,可二开扩展至多平台,例如:TikTok->视频号/抖音/小红书、抖音->TikTok/视频号/小红书......video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication.
Stealth Chromium engine that stops scrapers and browser agents from getting blocked, with one line of code change.
一款强大的Python视频去重GUI工具,采用高帧率抽帧混合算法,以规避短视频平台查重。支持GPU加速。video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication.
Scrape Amazon reviews with ScrapingBee's API, proxy rotation, and JavaScript rendering. Outputs name, rating, date, title, body to CSV.
Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook.
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist | Python | 908 | last pushed 5 years ago | |
| 2 | 全自动短视频搬运工具,支持自动下载、去重、AI生成标题+标签、上传,可二开扩展至多平台,例如:TikTok->视频号/抖音/小红书、抖音->TikTok/视频号/小红书......video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication. | Python | 576 | last pushed 5 weeks ago | |
| 3 | Stealth Chromium engine that stops scrapers and browser agents from getting blocked, with one line of code change. | Python | 485 | last pushed 2 months ago | |
| 4 | 一款强大的Python视频去重GUI工具,采用高帧率抽帧混合算法,以规避短视频平台查重。支持GPU加速。video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication. | Python | 288 | last pushed 5 weeks ago | |
| 5 | Scrape Amazon reviews with ScrapingBee's API, proxy rotation, and JavaScript rendering. Outputs name, rating, date, title, body to CSV. | — | 180 | last pushed 4 months ago | |
| 6 | Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook. | JavaScript | 136 | last pushed 6 months ago |
All · 11,658