You can now run Kimi K2.5 locally! 🔥
text
You can now run Kimi K2.5 locally! 🔥
new_line
new_line
We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.
text
We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.
new_line
Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.
text
Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.
new_line
new_line
GGUF: 
text
GGUF: 
https://huggingface.co/unsloth/Kimi-K2.5-GGUF
unsloth/Kimi-K2.5-GGUF
model
resource
https://huggingface.co/unsloth/Kimi-K2.5-GGUF
new_line
new_line
Guide: 
text
Guide: 
https://unsloth.ai/docs/models/kimi-k2.5
https://unsloth.ai/docs/models/kimi-k2.5
link
You can now run Kimi K2.5 locally! 🔥

We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.
Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.

GGUF: https://huggingface.co/unsloth/Kimi-K2.5-GGUF

Guide: https://unsloth.ai/docs/models/kimi-k2.5
🚀
itsthenewmeta victor Csplk johnlockejrr AdinaY jerryye hackgodrs1123 MaziyarPanahi CKL RoFoo bigdantf marksverdhei Pooya72 yuzhen17 John6666 Eryk-Chmielewski
😎
CompactAI hackgodrs1123 MaziyarPanahi
🔥
marksverdhei Pooya72
👀
hackgodrs1123
68926b2ae3584e309d2b02d8
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/qrRdaAf07aArzU7KSomSv.png
Yes no
Hellomaniamcoollol
user
6204304ddec9ca07e4411eca
https://cdn-avatars.huggingface.co/v1/production/uploads/6204304ddec9ca07e4411eca/xtO44tlG5UyUuZwKvUM8K.png
Markus
marksverdhei
user
6947f69751d7ae7c3c7b6908
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/PuIDZB9XDShHohKhYmdmp.png
Ben Kelly
YellowjacketGames
user
62ecdc18b72a69615d6bd857
https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/qAHhWJbSsmoezFHiErBUT.png
Daniel (Unsloth)
danielhanchen
user