Use the same GGUF you serve, merge the adapter back into it and then use the same engine to run the model, all in all a "LLM Toolbox"


Comments URL: https://news.ycombinator.com/item?id=50198844

Points: 1

# Comments: 0