A while ago, I presented this Phi2 DPO fine-tune notebook with LoRa. Got some input from 
text
A while ago, I presented this Phi2 DPO fine-tune notebook with LoRa. Got some input from 
@ybelkada
mention
ybelkada
  about not needing a 
text
  about not needing a 
ref_model
`ref_model`
inline_code
 because we can just swap out the LoRa adapters during training. Cool feature 🤓
text
 because we can just swap out the LoRa adapters during training. Cool feature 🤓
new_line
new_line
https://colab.research.google.com/drive/1PGMj7jlkJaCiSNNihA2NtpILsRgkRXrJ#scrollTo=wXqoH2TMnjjp
https://colab.research.google.com/drive/1PGMj7jlkJaCiSNNihA2NtpILsRgkRXrJ#scrollTo=wXqoH2TMnjjp
link
new_line
new_line
A while ago, I presented this Phi2 DPO fine-tune notebook with LoRa. Got some input from @ybelkada  about not needing a `ref_model` because we can just swap out the LoRa adapters during training. Cool feature 🤓

https://colab.research.google.com/drive/1PGMj7jlkJaCiSNNihA2NtpILsRgkRXrJ#scrollTo=wXqoH2TMnjjp


❤️
merve samusenps ybelkada alielfilali01 sumandas compressionsavant wise-east
🤝
ybelkada Stopwolf
62441d1d9fdefb55a0b7d12c
https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png
Younes B
ybelkada
user
626237d9bbcbd1c34f1bb231
https://cdn-avatars.huggingface.co/v1/production/uploads/626237d9bbcbd1c34f1bb231/EJrOjvAL-68qMCYdnvOrq.png
Ali El Filali
alielfilali01
user
634ff41ff32062e9eb7b06a3
https://cdn-avatars.huggingface.co/v1/production/uploads/1677141720071-634ff41ff32062e9eb7b06a3.jpeg
David Berenstein
davidberenstein1957
user
6214a3ec8cfaecd77a128062
/avatars/33ce42f3e6fef18ecbf29ef2dde8d457.svg
Justin Cho
wise-east
user