Always surprised that so few people actually read the FineTasks blog, on
text
Always surprised that so few people actually read the FineTasks blog, on
new_line
✨how to select training evals with the highest signal✨
text
✨how to select training evals with the highest signal✨
new_line
new_line
If you're serious about training models without wasting compute on shitty runs, you absolutely should read it!!
text
If you're serious about training models without wasting compute on shitty runs, you absolutely should read it!!
new_line
new_line
An high signal eval actually tells you precisely, during training, how wel & what your model is learning, allowing you to discard the bad runs/bad samplings/...!
text
An high signal eval actually tells you precisely, during training, how wel & what your model is learning, allowing you to discard the bad runs/bad samplings/...!
new_line
new_line
The blog covers in depth prompt choice, metrics, dataset, across languages/capabilities, and my fave section is "which properties should evals have"👌
text
The blog covers in depth prompt choice, metrics, dataset, across languages/capabilities, and my fave section is "which properties should evals have"👌
new_line
(to know on your use case how to select the best evals for you)
text
(to know on your use case how to select the best evals for you)
new_line
new_line
Blog: 
text
Blog: 
https://huggingface.co/spaces/HuggingFaceFW/blogpost-fine-tasks
HuggingFaceFW/blogpost-fine-tasks
space
resource
https://huggingface.co/spaces/HuggingFaceFW/blogpost-fine-tasks
Always surprised that so few people actually read the FineTasks blog, on
✨how to select training evals with the highest signal✨

If you're serious about training models without wasting compute on shitty runs, you absolutely should read it!!

An high signal eval actually tells you precisely, during training, how wel & what your model is learning, allowing you to discard the bad runs/bad samplings/...!

The blog covers in depth prompt choice, metrics, dataset, across languages/capabilities, and my fave section is "which properties should evals have"👌
(to know on your use case how to select the best evals for you)

Blog: https://huggingface.co/spaces/HuggingFaceFW/blogpost-fine-tasks
🤗
John6666
67f6710faa8ab00a1b8d1f07
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/j4syELhANCEr5IECsd_Ye.png
Eugenio Palumbo
eugpal4
user
6202a599216215a22221dea9
https://cdn-avatars.huggingface.co/v1/production/uploads/1644340617257-noauth.png
Clémentine Fourrier
clefourrier
user