Releasing HQQ Llama-3.1-70b 4-bit quantized version! Check it out at 
text
Releasing HQQ Llama-3.1-70b 4-bit quantized version! Check it out at 
https://huggingface.co/mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq
https://huggingface.co/mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq
link
. 
text
. 
new_line
new_line
Achieves 99% of the base model performance across various benchmarks! Details in the model card. 
text
Achieves 99% of the base model performance across various benchmarks! Details in the model card. 
new_line
Releasing HQQ Llama-3.1-70b 4-bit quantized version! Check it out at https://huggingface.co/mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq. 

Achieves 99% of the base model performance across various benchmarks! Details in the model card. 

🔥
mobicham osanseviero Lewdiculous wengaozhu proxima42 den0620 Bruhn John6666