crumb/qwen3.6-27B-cq3
Updated • 11
HQQ 3-bit w integrated LoRA APIs - BC official HQQ integration isn't here yet - RN investigating if 2bit is wrong or just always bad
Note Qwen/Qwen3.6-27B quantized to 3-bit precision
Note Qwen/Qwen3.5-9B quantized to 3-bit precision
Note Qwen/Qwen3.5-4B quantized to 3-bit precision
Note Qwen/Qwen3.5-2B quantized to 3-bit precision
Note Qwen/Qwen3.5-0.8B quantized to 3-bit precision