PuerkitoBio/gocrawl · MMO ALL

MMO ALLBuild · Share · Earn

Home Community Projects Following GitHub Insight Opportunity Radar

/

Build · Share · Earn

Pages

About
Rules
Guide

Connect

© 2026 MMO ALL. All rights reserved.

PuerkitoBio/gocrawl · MMO ALL

← Back to Insight

PuerkitoBio

PuerkitoBio

PuerkitoBio/gocrawl

Polite, slim and concurrent web crawler.

2,051

Stars

196

Forks

6

Open issues

2,051

Watchers

BSD-3-Clause

License

Go

Language

Sep 19, 2012

Created

May 19, 2021

Last pushed

+0

Star growth · 1 day

Not enough data yet

Star growth · 7 days

Not enough data yet

Star growth · 30 days

Topics

crawler robots-txt

Stars over the last 90 days