GitHub repo leaderboard by stars, growth rate and activity.

• haotian-liu

  #1haotian-liu/LLaVA

  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

  Python25,018 starslast pushed 2 years ago
• NExT-GPT

  #2NExT-GPT/NExT-GPT

  Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

  Python3,634 starslast pushed 1 year ago
• EvolvingLMMs-Lab

  #3EvolvingLMMs-Lab/Otter

  🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

  Python3,438 starslast pushed 3 years ago
• InternLM

  #4InternLM/InternLM-XComposer

  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

  Python2,927 starslast pushed 1 year ago

#	Repo	Language	Stars	30-day trend	Last updated
1	haotian-liu haotian-liu/LLaVA [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.	Python	25,018		last pushed 2 years ago
2	NExT-GPT NExT-GPT/NExT-GPT Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model	Python	3,634		last pushed 1 year ago
3	EvolvingLMMs-Lab EvolvingLMMs-Lab/Otter 🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.	Python	3,438		last pushed 3 years ago
4	InternLM InternLM/InternLM-XComposer InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions	Python	2,927		last pushed 1 year ago

All · 11,658