GitHub repo leaderboard by stars, growth rate and activity.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
An orchestration platform for the development, production, and observation of data assets.
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Build data pipelines, the easy way 🛠️
A system for agentic LLM-powered data processing and ETL
Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
AI agent tooling for data engineering workflows.
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. | Python | 62,312 | last pushed Yesterday | |
| 2 | Apache Airflow - A platform to programmatically author, schedule, and monitor workflows | Python | 46,799 | last pushed 23 hours ago | |
| 3 | An orchestration platform for the development, production, and observation of data assets. | Python | 16,134 | last pushed Yesterday | |
| 4 | Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding. | HTML | 15,412 | last pushed 23 hours ago | |
| 5 | Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code | Java | 14,462 | last pushed 2 days ago | |
| 6 | Build data pipelines, the easy way 🛠️ | TypeScript | 4,131 | last pushed 3 years ago | |
| 7 | A system for agentic LLM-powered data processing and ETL | Python | 4,081 | last pushed 5 days ago | |
| 8 | Maestro: Netflix’s Workflow Orchestrator | Java | 3,834 | last pushed 1 week ago | |
| 9 | Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages. | Rust | 1,773 | last pushed 2 years ago | |
| 10 | AI agent tooling for data engineering workflows. | Python | 439 | last pushed 5 days ago |
All · 11,474