LLaVA-NeXT is recently merged to Hugging Face transformers and it outperforms many of the closed source models like Gemini on various benchmarks 🤩  Let's take a look!
text
LLaVA-NeXT is recently merged to Hugging Face transformers and it outperforms many of the closed source models like Gemini on various benchmarks 🤩  Let's take a look!
new_line
Demo: 
text
Demo: 
https://huggingface.co/spaces/merve/llava-next
merve/llava-next
space
resource
https://huggingface.co/spaces/merve/llava-next
new_line
Notebook: 
text
Notebook: 
https://colab.research.google.com/drive/1afNudu72SNWZCYtCVrRlb9T9Vj9CFJEK?usp=sharing
https://colab.research.google.com/drive/1afNudu72SNWZCYtCVrRlb9T9Vj9CFJEK?usp=sharing
link
new_line
LLaVA is essentially a vision-language model that consists of ViT-based CLIP encoder, a MLP projection and Vicuna as decoder ✨
text
LLaVA is essentially a vision-language model that consists of ViT-based CLIP encoder, a MLP projection and Vicuna as decoder ✨
new_line
LLaVA 1.5 was released with Vicuna, but LLaVA NeXT (1.6) is released with four different LLMs:
text
LLaVA 1.5 was released with Vicuna, but LLaVA NeXT (1.6) is released with four different LLMs:
new_line
- Nous-Hermes-Yi-34B
text
- Nous-Hermes-Yi-34B
new_line
- Mistral-7B
text
- Mistral-7B
new_line
- Vicuna 7B & 13B 
text
- Vicuna 7B & 13B 
new_line
Mistral and Nous-Hermes-Yi-34B are performing better and have better commercial use. 
text
Mistral and Nous-Hermes-Yi-34B are performing better and have better commercial use. 
new_line
Moreover, according to authors' findings, the improvements comes from more diverse and high quality data mixture and dynamic high resolution.
text
Moreover, according to authors' findings, the improvements comes from more diverse and high quality data mixture and dynamic high resolution.
new_line
LLaVA based on Nous-Hermes-Yi-34B outperforms many other models, including Gemini in various multimodal understanding and generation benchmarks 😊 
text
LLaVA based on Nous-Hermes-Yi-34B outperforms many other models, including Gemini in various multimodal understanding and generation benchmarks 😊 
LLaVA-NeXT is recently merged to Hugging Face transformers and it outperforms many of the closed source models like Gemini on various benchmarks 🤩  Let's take a look!
Demo: https://huggingface.co/spaces/merve/llava-next
Notebook: https://colab.research.google.com/drive/1afNudu72SNWZCYtCVrRlb9T9Vj9CFJEK?usp=sharing
LLaVA is essentially a vision-language model that consists of ViT-based CLIP encoder, a MLP projection and Vicuna as decoder ✨
LLaVA 1.5 was released with Vicuna, but LLaVA NeXT (1.6) is released with four different LLMs:
- Nous-Hermes-Yi-34B
- Mistral-7B
- Vicuna 7B & 13B 
Mistral and Nous-Hermes-Yi-34B are performing better and have better commercial use. 
Moreover, according to authors' findings, the improvements comes from more diverse and high quality data mixture and dynamic high resolution.
LLaVA based on Nous-Hermes-Yi-34B outperforms many other models, including Gemini in various multimodal understanding and generation benchmarks 😊 
🚀
osanseviero samusenps yesdeepakmittalTA Dlbk InferenceIllusionist nqtruong mirellyssl acamilogg88 clem LucienL shing3232 jarvisx17