I created a DL inference engine that slowly grew to have more and functionality.

- Inference for a bunch of open weights architectures

- Diffusion image generation fir Z ai turbo

- Vision input into LLM for inference

- Vulkan/fast CPU, optimized kernels

- Playground for testing

- Last but not least, system one fast inference mode with same API semantics as Jev

It's MIT, so go nuts


Comments URL: https://news.ycombinator.com/item?id=50091939

Points: 2

# Comments: 0