Blurred-Thoughts Supervised-Finetuning 🙈 
text
Blurred-Thoughts Supervised-Finetuning 🙈 
new_line
new_line
After hours of working with GitHub Copilot to organize the code, I'm keen to announce the release of Blurred Thoughts Supervised-Finetuning (BT-SFT), a new method for fine-tuning LLMs to produce more diverse and creative responses.
text
After hours of working with GitHub Copilot to organize the code, I'm keen to announce the release of Blurred Thoughts Supervised-Finetuning (BT-SFT), a new method for fine-tuning LLMs to produce more diverse and creative responses.
new_line
new_line
BT-SFT introduces:
text
BT-SFT introduces:
new_line
✅ Smart tokenization method randomly masks tokens within <think> ... </think> tags, promoting the model to generate diverse responses that align better with its probability distribution instead of memorizing the thought process from distilled data.
text
✅ Smart tokenization method randomly masks tokens within <think> ... </think> tags, promoting the model to generate diverse responses that align better with its probability distribution instead of memorizing the thought process from distilled data.
new_line
✅ Reward function that ensures responses are well-structured.
text
✅ Reward function that ensures responses are well-structured.
new_line
new_line
Explore and contribute to the project available in my GitHub repository: 
text
Explore and contribute to the project available in my GitHub repository: 
new_line
https://github.com/mkurman/blurred-thoughts-SFT
https://github.com/mkurman/blurred-thoughts-SFT
link
new_line
new_line
Keep me updated on your experiments with BT-SFT! 🐐
text
Keep me updated on your experiments with BT-SFT! 🐐
Blurred-Thoughts Supervised-Finetuning 🙈 

After hours of working with GitHub Copilot to organize the code, I'm keen to announce the release of Blurred Thoughts Supervised-Finetuning (BT-SFT), a new method for fine-tuning LLMs to produce more diverse and creative responses.

BT-SFT introduces:
✅ Smart tokenization method randomly masks tokens within <think> ... </think> tags, promoting the model to generate diverse responses that align better with its probability distribution instead of memorizing the thought process from distilled data.
✅ Reward function that ensures responses are well-structured.

Explore and contribute to the project available in my GitHub repository: 
https://github.com/mkurman/blurred-thoughts-SFT

Keep me updated on your experiments with BT-SFT! 🐐
👍
oieieio jackangel maxrubin629 fireblade2535 dingo-actual
👀
John6666 dantezxcd