-UPDATED-
text
-UPDATED-
new_line
4bit inference is working! The blogpost is updated with code snippet and requirements.txt
text
4bit inference is working! The blogpost is updated with code snippet and requirements.txt
new_line
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
link
new_line
-UPDATED-
text
-UPDATED-
new_line
I've played around with an MI100 and ROCm and collected my experience in a blogpost:
text
I've played around with an MI100 and ROCm and collected my experience in a blogpost:
new_line
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
link
new_line
Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
text
Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
new_line
-UPDATED-
4bit inference is working! The blogpost is updated with code snippet and requirements.txt
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
-UPDATED-
I've played around with an MI100 and ROCm and collected my experience in a blogpost:
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.

👍
John6666 rahul-rokkun Tonioesparza Kotokin dantezxcd
🔥
rahul-rokkun stefan-it dantezxcd
🚀
rahul-rokkun
👀
rahul-rokkun
🤗
rahul-rokkun
❤️
rahul-rokkun
😎
rahul-rokkun
➕
rahul-rokkun
🧠
rahul-rokkun
🤝
rahul-rokkun
😔
rahul-rokkun
🤯
rahul-rokkun
636811cf94022a5a7bcefb78
/avatars/788180bfe9201f88cdcb90afaa5454de.svg
NIkita Balakin
Kotokin
user
64e6d37e02dee9bcb9d9fa18
https://cdn-avatars.huggingface.co/v1/production/uploads/64e6d37e02dee9bcb9d9fa18/os24VYiNCoyth9yQSdv_A.jpeg
Csaba  Kecskemeti
csabakecskemeti
user