Use the same GGUF you serve, merge the adapter back into it and then use the same engine to run the model, all in all a "LLM Toolbox"
Comments URL: https://news.ycombinator.com/item?id=50198844
Points: 1
# Comments: 0
Use the same GGUF you serve, merge the adapter back into it and then use the same engine to run the model, all in all a "LLM Toolbox"
Comments URL: https://news.ycombinator.com/item?id=50198844
Points: 1
# Comments: 0



