Microsoft released LLM2CLIP: a CLIP model with longer context window for complex text inputs 🤯
text
Microsoft released LLM2CLIP: a CLIP model with longer context window for complex text inputs 🤯
new_line
All models with Apache 2.0 license here 
text
All models with Apache 2.0 license here 
https://huggingface.co/collections/microsoft/llm2clip-672323a266173cfa40b32d4c
microsoft/llm2clip-672323a266173cfa40b32d4c
collection
resource
https://huggingface.co/collections/microsoft/llm2clip-672323a266173cfa40b32d4c
new_line
new_line
TLDR; they replaced CLIP's text encoder with various LLMs fine-tuned on captioning, better top-k accuracy on retrieval.
text
TLDR; they replaced CLIP's text encoder with various LLMs fine-tuned on captioning, better top-k accuracy on retrieval.
new_line
This will enable better image-text retrieval, better zero-shot image classification, better vision language models 🔥
text
This will enable better image-text retrieval, better zero-shot image classification, better vision language models 🔥
new_line
Read the paper to learn more: 
text
Read the paper to learn more: 
LLM2CLIP: Powerful Language Model Unlock Richer Visual Representation (2411.04997)
https://huggingface.co/papers/2411.04997
2411.04997
paper
resource
https://huggingface.co/papers/2411.04997
Microsoft released LLM2CLIP: a CLIP model with longer context window for complex text inputs 🤯
All models with Apache 2.0 license here https://huggingface.co/collections/microsoft/llm2clip-672323a266173cfa40b32d4c

TLDR; they replaced CLIP's text encoder with various LLMs fine-tuned on captioning, better top-k accuracy on retrieval.
This will enable better image-text retrieval, better zero-shot image classification, better vision language models 🔥
Read the paper to learn more: https://huggingface.co/papers/2411.04997
🚀
John6666 Yif29 Chroma111
🤗
prithivMLmods Yif29 Chroma111
😎
maxiw Yif29
🔥
Chroma111 theospeak
❤️
Chroma111