is there any plan to release fp8 or awq quantized model?
We are working on it. Thank you.
Hi @ziozzang , 4bit and 8bit AWQ models are out at @cyankiwi.
· Sign up or log in to comment
