We just released bitsandbytes==0.43.0 📦 , with these significant new additions:
text
We just released bitsandbytes==0.43.0 📦 , with these significant new additions:
new_line
new_line
‣ 🛫 FSDP+QLoRA support (alpha release)
text
‣ 🛫 FSDP+QLoRA support (alpha release)
new_line
  ◦ now anyone with 2 powerful gaming GPUs can fine-tune 70B param models at home!
text
  ◦ now anyone with 2 powerful gaming GPUs can fine-tune 70B param models at home!
new_line
  ◦ in collab with Jeremy Howard + team @ answer.ai
text
  ◦ in collab with Jeremy Howard + team @ answer.ai
new_line
  ◦ answer.ai blogpost: 
text
  ◦ answer.ai blogpost: 
https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html
https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html
link
new_line
  ◦ example repo: 
text
  ◦ example repo: 
https://github.com/AnswerDotAI/fsdp_qlora/
https://github.com/AnswerDotAI/fsdp_qlora/
link
new_line
new_line
‣ 🌈⊞ Official Windows support
text
‣ 🌈⊞ Official Windows support
new_line
  ◦ now via simple 
text
  ◦ now via simple 
pip install bitsandbytes>=0.43.0
`pip install bitsandbytes>=0.43.0`
inline_code
new_line
new_line
‣ 📄 Huge docs update:
text
‣ 📄 Huge docs update:
new_line
  ◦ 
text
  ◦ 
https://huggingface.co/docs/bitsandbytes/main
https://huggingface.co/docs/bitsandbytes/main
link
new_line
  ◦ Be sure to check out the optimizers and the API docs
text
  ◦ Be sure to check out the optimizers and the API docs
new_line
  ◦ ... even more upcoming ...
text
  ◦ ... even more upcoming ...
new_line
new_line
Under the hood there we have many other improvements, due to extensive maintenance activity, community contributions by super active + knowledgable volunteers ✨ 🚀 and the official sponsorship by Hugging Face that makes all this possible 🤗 ❤️ 🌍
text
Under the hood there we have many other improvements, due to extensive maintenance activity, community contributions by super active + knowledgable volunteers ✨ 🚀 and the official sponsorship by Hugging Face that makes all this possible 🤗 ❤️ 🌍
new_line
new_line
We would greatly appreciate any further community contributions, be it to help with refactorings, exterminating flaky tests, writing doc-strings, tutorials, new features. Don't be shy, just contact us and we see where this leads us:
text
We would greatly appreciate any further community contributions, be it to help with refactorings, exterminating flaky tests, writing doc-strings, tutorials, new features. Don't be shy, just contact us and we see where this leads us:
new_line
https://github.com/TimDettmers/bitsandbytes/discussions
https://github.com/TimDettmers/bitsandbytes/discussions
link
new_line
new_line
Have a great weekend everyone!
text
Have a great weekend everyone!
We just released bitsandbytes==0.43.0 📦 , with these significant new additions:

‣ 🛫 FSDP+QLoRA support (alpha release)
  ◦ now anyone with 2 powerful gaming GPUs can fine-tune 70B param models at home!
  ◦ in collab with Jeremy Howard + team @ answer.ai
  ◦ answer.ai blogpost: https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html
  ◦ example repo: https://github.com/AnswerDotAI/fsdp_qlora/

‣ 🌈⊞ Official Windows support
  ◦ now via simple `pip install bitsandbytes>=0.43.0`

‣ 📄 Huge docs update:
  ◦ https://huggingface.co/docs/bitsandbytes/main
  ◦ Be sure to check out the optimizers and the API docs
  ◦ ... even more upcoming ...

Under the hood there we have many other improvements, due to extensive maintenance activity, community contributions by super active + knowledgable volunteers ✨ 🚀 and the official sponsorship by Hugging Face that makes all this possible 🤗 ❤️ 🌍

We would greatly appreciate any further community contributions, be it to help with refactorings, exterminating flaky tests, writing doc-strings, tutorials, new features. Don't be shy, just contact us and we see where this leads us:
https://github.com/TimDettmers/bitsandbytes/discussions

Have a great weekend everyone!
🤗
Titus-von-Koeller mdouglas clem osanseviero rganti ajibawa-2023 julien-c t1u1 ybelkada cstr tolgacangoz hiyouga danielus smangrul
❤️
Djruffkutz clem osanseviero samusenps julien-c Theli ybelkada hiyouga smangrul
5dd96eb166059660ed1ee413
https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/NQtzmrDdbG0H8qkZvRyGk.jpeg
Julien Chaumond
julien-c
user