[Add] Q4 Versions?

#1
by Milor123 - opened

Could you share the Q4 Versions?
Thank you very much !

I can try making them.

I made a Q4_K_M one. @Milor123 Is that small enough for your use case?

I made a Q4_K_M one. @Milor123 Is that small enough for your use case?

Ohh amazing!! Thank u very much man !! Yes it should work now for me!

How do you use it guys? Any comfyui node yet?

@kukalikuk This quant was made to test (or be used with) a pending PR for stable-diffusion.cpp that implements support for this model. I don't think it works with ComfyUI yet, but I might be wrong about that.
https://github.com/leejet/stable-diffusion.cpp/pull/1053

Has anyone tried it on google colab? Or on a server? Cause I'm confused and don't know how to use it in a python code due to being gguf.
If anyone has a solution please give me a contact way like gmail to discuss about it.

Sign up or log in to comment