Q2_K in revision: user report that 1.1 is giving issues

#5
by realrebelai - opened

I ran a bunch of tests last night with FLF and every generation came out blurry and cooked. Just wanted to let you know! Maybe something happenee during compression?

QuantStack org

Strange. What GGUF are you using? Can you share your settings in workflow also? I didn’t get that issues

using the FLF workflow. im using the Q2 gguf!

Screenshot (95)

im not sure what this issue is tbh, the regular 1.0 works great

I need to test that Q2_K but in running the Q3_K_S and its fine

Add: And the quantization its the same used in 1.0

i am using Q4_K_M and its flawless thanks for the quants !!

YarvixPA changed discussion title from 1.1 giving issues to Q2_K in revision: user report that 1.1 is giving issues

Maybe its a me issue, could be my comfy causing it im not sure, i dont want to steer people in the wrong direction because others have reported it works great. Ill test a higher quant later to see if its me or the lower quant 🤷‍♂️

Sign up or log in to comment