Is streaming possible with this .gguf?

by DoS007 - opened 19 days ago

DoS007

19 days ago

see subject

Owner 19 days ago

gpu faster; streaming might work, not yet tested

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment