GitHub repo leaderboard by stars, growth rate and activity.

• intel

  #1intel/intel-extension-for-transformersArchived

  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

  Python2,171 starslast pushed 2 years ago
• syv-ai

  #2syv-ai/qwen38-27b-rtx3090

  Qwen3.8-27B on a single RTX 3090 with vLLM: ~1,000 tok/s at 64 concurrent (int8 tensor-core GEMMs, fp16 DeltaNet state), ~114 tok/s single-user at default sampling / ~124 greedy (MTP drafts, own-output draft vocab, calibrated int4 lm_head, split-KV verify attention), 150k-262k context; patches, requant scripts, benchmarks

  Python1,266 starslast pushed 19 hours ago

#	Repo	Language	Stars	30-day trend	Last updated
1	intel intel/intel-extension-for-transformersArchived ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡	Python	2,171		last pushed 2 years ago
2	syv-ai syv-ai/qwen38-27b-rtx3090 Qwen3.8-27B on a single RTX 3090 with vLLM: ~1,000 tok/s at 64 concurrent (int8 tensor-core GEMMs, fp16 DeltaNet state), ~114 tok/s single-user at default sampling / ~124 greedy (MTP drafts, own-output draft vocab, calibrated int4 lm_head, split-KV verify attention), 150k-262k context; patches, requant scripts, benchmarks	Python	1,266		last pushed 19 hours ago

All · 11,658