If you have ~300+ GB of V-RAM, you can run Mochi from 
text
If you have ~300+ GB of V-RAM, you can run Mochi from 
@genmo
mention
genmo
new_line
new_line
A SOTA model that dramatically closes the gap between closed and open video generation models.  
text
A SOTA model that dramatically closes the gap between closed and open video generation models.  
new_line
new_line
Mochi 1 introduces revolutionary architecture featuring joint reasoning over 44,520 video tokens with full 3D attention. The model implements extended learnable rotary positional embeddings (RoPE) in three dimensions, with network-learned mixing frequencies for space and time axes.  
text
Mochi 1 introduces revolutionary architecture featuring joint reasoning over 44,520 video tokens with full 3D attention. The model implements extended learnable rotary positional embeddings (RoPE) in three dimensions, with network-learned mixing frequencies for space and time axes.  
new_line
new_line
The model incorporates cutting-edge improvements, including:  
text
The model incorporates cutting-edge improvements, including:  
new_line
- SwiGLU feedforward layers  
text
- SwiGLU feedforward layers  
new_line
- Query-key normalization for enhanced stability  
text
- Query-key normalization for enhanced stability  
new_line
- Sandwich normalization for controlled internal activations 
text
- Sandwich normalization for controlled internal activations 
new_line
new_line
What is currently available?
text
What is currently available?
new_line
The base model delivers impressive 480p video generation with exceptional motion quality and prompt adherence. Released under the Apache 2.0 license, it's freely available for both personal and commercial applications.  
text
The base model delivers impressive 480p video generation with exceptional motion quality and prompt adherence. Released under the Apache 2.0 license, it's freely available for both personal and commercial applications.  
new_line
new_line
What's Coming?
text
What's Coming?
new_line
Genmo has announced Mochi 1 HD, scheduled for release later this year, which will feature:  
text
Genmo has announced Mochi 1 HD, scheduled for release later this year, which will feature:  
new_line
- Enhanced 720p resolution  
text
- Enhanced 720p resolution  
new_line
- Improved motion fidelity  
text
- Improved motion fidelity  
new_line
- Better handling of complex scene warping 
text
- Better handling of complex scene warping 
If you have ~300+ GB of V-RAM, you can run Mochi from @genmo

A SOTA model that dramatically closes the gap between closed and open video generation models.  

Mochi 1 introduces revolutionary architecture featuring joint reasoning over 44,520 video tokens with full 3D attention. The model implements extended learnable rotary positional embeddings (RoPE) in three dimensions, with network-learned mixing frequencies for space and time axes.  

The model incorporates cutting-edge improvements, including:  
- SwiGLU feedforward layers  
- Query-key normalization for enhanced stability  
- Sandwich normalization for controlled internal activations 

What is currently available?
The base model delivers impressive 480p video generation with exceptional motion quality and prompt adherence. Released under the Apache 2.0 license, it's freely available for both personal and commercial applications.  

What's Coming?
Genmo has announced Mochi 1 HD, scheduled for release later this year, which will feature:  
- Enhanced 720p resolution  
- Improved motion fidelity  
- Better handling of complex scene warping 
❤️
clem akhaliq thomwolf sepal AtAndDev theospeak VDBLOI2024 abhi22 RaphaelLiu viktsys DivaVivy
🔥
sugatoray Aurelien-Morgan AtAndDev abhi22
👀
John6666 AtAndDev
662946b5350884c427ef0e43
https://cdn-avatars.huggingface.co/v1/production/uploads/662946b5350884c427ef0e43/cXry7Sosxjyg1Ng58qeoq.jpeg
Natwar Upadhyay
Natwar
user
630fdd96a119d49bc1e770d5
https://cdn-avatars.huggingface.co/v1/production/uploads/630fdd96a119d49bc1e770d5/OpU95S4a8hkM8OUCZq79R.jpeg
Adam
adamo1139
user