Pay per pre-configured GPU hour or per token for open-source LLM inference?

Is it worth paying for a pre-configured GPU for open-source LLM inference instead of using a traditional pay-per-token provider? The biggest advantage seems to be having no usage limits

---

Comments URL: https://news.ycombinator.com/item?id=50420874

Points: 1

# Comments: 0