Yesterday, I shared a blog post on generating data for fine-tuning ColPali using the 
text
Yesterday, I shared a blog post on generating data for fine-tuning ColPali using the 
https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct
Qwen/Qwen2-VL-7B-Instruct
model
resource
https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct
 model.
text
 model.
new_line
new_line
To simplify testing this approach, I created a Space that lets you generate queries from an input document page image: 
text
To simplify testing this approach, I created a Space that lets you generate queries from an input document page image: 
https://huggingface.co/spaces/davanstrien/ColPali-Query-Generator
davanstrien/ColPali-Query-Generator
space
resource
https://huggingface.co/spaces/davanstrien/ColPali-Query-Generator
new_line
new_line
I think there is much room for improvement, but I'm excited about the potential for relatively small VLMs to create synthetic data.
text
I think there is much room for improvement, but I'm excited about the potential for relatively small VLMs to create synthetic data.
new_line
new_line
You can read the original blog post that goes into more detail here: 
text
You can read the original blog post that goes into more detail here: 
https://danielvanstrien.xyz/posts/post-with-code/colpali/2024-09-23-generate_colpali_dataset.html
https://danielvanstrien.xyz/posts/post-with-code/colpali/2024-09-23-generate_colpali_dataset.html
link
Yesterday, I shared a blog post on generating data for fine-tuning ColPali using the https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct model.

To simplify testing this approach, I created a Space that lets you generate queries from an input document page image: https://huggingface.co/spaces/davanstrien/ColPali-Query-Generator

I think there is much room for improvement, but I'm excited about the potential for relatively small VLMs to create synthetic data.

You can read the original blog post that goes into more detail here: https://danielvanstrien.xyz/posts/post-with-code/colpali/2024-09-23-generate_colpali_dataset.html
➕
blooket John6666 AtAndDev victor fsommers
❤️
louisbrulenaudet AtAndDev Csplk johko
👍
fsommers UniLLMer
🚀
AtAndDev