GitHub Open Source Insight
Computed at Sep 11, 2026GitHub repo leaderboard by stars, growth rate and activity.
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
TypeScript34,413 starslast pushed 23 hours agomlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Python27,892 starslast pushed 23 hours agopromptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
TypeScript24,982 starslast pushed 22 hours agocomet-ml
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Python21,906 starslast pushed 23 hours agoArize-ai
Tencent
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
Python6,215 starslast pushed 22 hours agoHelicone
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
TypeScript6,141 starslast pushed 2 weeks agoQ00
Agent OS: the agent gets smarter on its own. We just hold the line: Interview-gated, staged evaluation, budgeted evolution loop. MCP server, 14 runtimes: Claude Code, Codex CLI, Gemini CLI, OpenCode, Copilot, Kiro and more.
Python5,803 starslast pushed YesterdayPacktPublishing
The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices
Python5,319 starslast pushed 5 months agoMarker-Inc-Korea
AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.
TypeScript5,064 starslast pushed Yesterday
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | langfuse 🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23 | TypeScript | 34,413 | last pushed 23 hours ago | |
| 2 | mlflow The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data. | Python | 27,892 | last pushed 23 hours ago | |
| 3 | promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic. | TypeScript | 24,982 | last pushed 22 hours ago | |
| 4 | comet-ml Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. | Python | 21,906 | last pushed 23 hours ago | |
| 5 | Arize-ai AI Observability & Evaluation | Python | 11,399 | last pushed 22 hours ago | |
| 6 | Tencent A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation. | Python | 6,215 | — | last pushed 22 hours ago |
| 7 | Helicone 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓 | TypeScript | 6,141 | last pushed 2 weeks ago | |
| 8 | Q00 Agent OS: the agent gets smarter on its own. We just hold the line: Interview-gated, staged evaluation, budgeted evolution loop. MCP server, 14 runtimes: Claude Code, Codex CLI, Gemini CLI, OpenCode, Copilot, Kiro and more. | Python | 5,803 | last pushed Yesterday | |
| 9 | PacktPublishing The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices | Python | 5,319 | last pushed 5 months ago | |
| 10 | Marker-Inc-Korea AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently. | TypeScript | 5,064 | last pushed Yesterday |
All · 11,474