The Meta Llama-3.1 model series can be used for distilling and fine-tuning but this requires annotated preference data so I created a Human Feedback Collector based on Gradio that directly logs data to the Hugging Face Hub. 
text
The Meta Llama-3.1 model series can be used for distilling and fine-tuning but this requires annotated preference data so I created a Human Feedback Collector based on Gradio that directly logs data to the Hugging Face Hub. 
new_line
new_line
- Model meta-llama/Meta-Llama-3.1-8B-Instruct
text
- Model meta-llama/Meta-Llama-3.1-8B-Instruct
new_line
- Data SFT, KTO and DPO data
text
- Data SFT, KTO and DPO data
new_line
- Runs on free Zero GPUs in Hugging Face Spaces
text
- Runs on free Zero GPUs in Hugging Face Spaces
new_line
- Might need some human curation in Argilla
text
- Might need some human curation in Argilla
new_line
- Or provide some AI feedback with distilabel
text
- Or provide some AI feedback with distilabel
new_line
new_line
https://huggingface.co/collections/davidberenstein1957/chatinterface-llm-human-feedback-collectors-66a22859c9e703d2af7500c1
https://huggingface.co/collections/davidberenstein1957/chatinterface-llm-human-feedback-collectors-66a22859c9e703d2af7500c1
link
The Meta Llama-3.1 model series can be used for distilling and fine-tuning but this requires annotated preference data so I created a Human Feedback Collector based on Gradio that directly logs data to the Hugging Face Hub. 

- Model meta-llama/Meta-Llama-3.1-8B-Instruct
- Data SFT, KTO and DPO data
- Runs on free Zero GPUs in Hugging Face Spaces
- Might need some human curation in Argilla
- Or provide some AI feedback with distilabel

https://huggingface.co/collections/davidberenstein1957/chatinterface-llm-human-feedback-collectors-66a22859c9e703d2af7500c1
🔥
fdaudens davidberenstein1957 osanseviero Dihelson Nelathan Ramikan-BR
🚀
davidberenstein1957 osanseviero NickyNicky Dihelson danielus Ramikan-BR
❤️
Ramikan-BR
👍
seralf