how to modify llama.cpp llama-server source code
#1
by
elfarolab
- opened
Hello,
I can't use your runner because I have different version of glibc. So in order to make it works, I should compile from source your llama-server version called "llama-liquid-audio-server".
I was searching your github for source files but I didn't found them, any plan to release upstream your modifications of llama.cpp?
Can't use the python server version either. I am building my system with llama.cpp from source.
Is there any way to run this new release of ASR/TTS + your vocoder + tokenizer with llama.cpp?
Thank you so much.
elfarolab
changed discussion title from
how to modify llama-server, option -mv
to how to modify llama.cpp, llama-server source code
elfarolab
changed discussion title from
how to modify llama.cpp, llama-server source code
to how to modify llama.cpp llama-server source code
Hi @elfarolab , the code has been pushed to https://github.com/ggml-org/llama.cpp/pull/18641. It's WIP and will take some time to land in upstream.
tarek-liquid
changed discussion status to
closed