cxcscmu/Craw4LLM · MMO ALL

MMO ALLBuild · Share · Earn

Home Community Projects Following GitHub Insight Opportunity Radar

/

Build · Share · Earn

Pages

About
Rules
Guide

Connect

© 2026 MMO ALL. All rights reserved.

cxcscmu/Craw4LLM · MMO ALL

← Back to Insight

cxcscmu

cxcscmu

cxcscmu/Craw4LLM

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

Open on GitHub Project homepage

664

Stars

60

Forks

4

Open issues

664

Watchers

MIT

License

Python

Language

Feb 17, 2025

Created

Feb 24, 2025

Last pushed

+0

Star growth · 1 day

Not enough data yet

Star growth · 7 days

Not enough data yet

Star growth · 30 days

Topics

crawler crawling large-language-models llm pre-training pretraining web-crawler web-crawling

Stars over the last 90 days