I created a DL inference engine that slowly grew to have more and functionality.
- Inference for a bunch of open weights architectures
- Diffusion image generation fir Z ai turbo
- Vision input into LLM for inference
- Vulkan/fast CPU, optimized kernels
- Playground for testing
- Last but not least, system one fast inference mode with same API semantics as Jev
It's MIT, so go nuts
Comments URL: https://news.ycombinator.com/item?id=50091939
Points: 2
# Comments: 0
