Excited to introduce Jamba by AI21
text
Excited to introduce Jamba by AI21
new_line
https://huggingface.co/ai21labs/Jamba-v0.1
ai21labs/Jamba-v0.1
model
resource
https://huggingface.co/ai21labs/Jamba-v0.1
new_line
new_line
We are thrilled to announce Jamba, the world’s first production-grade Mamba based model. 
text
We are thrilled to announce Jamba, the world’s first production-grade Mamba based model. 
new_line
new_line
Key Features: 
text
Key Features: 
new_line
- First production-grade Mamba based model built on a novel SSM-Transformer hybrid architecture
text
- First production-grade Mamba based model built on a novel SSM-Transformer hybrid architecture
new_line
- 3X throughput on long contexts compared to Mixtral 8x7B
text
- 3X throughput on long contexts compared to Mixtral 8x7B
new_line
- Democratizes access to a massive 256K context window
text
- Democratizes access to a massive 256K context window
new_line
- The only model in its size class that fits up to 140K context on a single GPU 
text
- The only model in its size class that fits up to 140K context on a single GPU 
new_line
new_line
Jamba is based on a novel architecture that combines Mamba and Transformer. While our initial results show great efficiency gains, we expect this to be further explored and improved with the help of the community.
text
Jamba is based on a novel architecture that combines Mamba and Transformer. While our initial results show great efficiency gains, we expect this to be further explored and improved with the help of the community.
new_line
new_line
Check out our blog post for more info: 
text
Check out our blog post for more info: 
https://ai21-labs.webflow.io/blog/announcing-jamba
https://ai21-labs.webflow.io/blog/announcing-jamba
link
new_line
Excited to introduce Jamba by AI21
https://huggingface.co/ai21labs/Jamba-v0.1

We are thrilled to announce Jamba, the world’s first production-grade Mamba based model. 

Key Features: 
- First production-grade Mamba based model built on a novel SSM-Transformer hybrid architecture
- 3X throughput on long contexts compared to Mixtral 8x7B
- Democratizes access to a massive 256K context window
- The only model in its size class that fits up to 140K context on a single GPU 

Jamba is based on a novel architecture that combines Mamba and Transformer. While our initial results show great efficiency gains, we expect this to be further explored and improved with the help of the community.

Check out our blog post for more info: https://ai21-labs.webflow.io/blog/announcing-jamba

🔥
osanseviero nikgr taufiqdp samusenps ajibawa-2023 Srulikbdd theKibster victor VictorSanh reach-vb apollomarv Asaf-Yehudai MaziyarPanahi DataSoul callmeraxz tatakof
🚀
osanseviero samusenps aswathitsme Srulikbdd reach-vb MaziyarPanahi
😎
osanseviero sadafwalliyani reach-vb wenbopan
👍
sadafwalliyani shiv2050 wenbopan DataSoul
❤️
samusenps reach-vb Aurelien-Morgan
🤯
osanseviero reach-vb
🤝
shiv2050
➕
wenbopan
64aea8ff67511bd3d965697b
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user
62cd5057674cdb524450093d
https://cdn-avatars.huggingface.co/v1/production/uploads/62cd5057674cdb524450093d/f67rlrdsKPRTLdXCXoa_X.jpeg
Mayank Mishra
mayank-mishra
user