TLDR AI · ENGINEERING & RESOURCES
ZML INFERENCE
Summary from the TLDR AI newsletter
ZML is a lightning fast inference engine written in Zig that is designed with performance in mind. It can be used for a variety of models, although it requires some customization to get working for a new architecture.