Eight months ago, EXO labs promised fast inference on local hardware. But it is not fast enough. It takes a minute and a half to get a response through hermes, using Kimi K2.6. Is there hardware that a dev can buy that can actually offset cloud bills?
Comments URL: https://news.ycombinator.com/item?id=50394913
Points: 1
# Comments: 0
