TLDR AI · ENGINEERING & RESOURCES

ZML INFERENCE

github.comGitHub repository

Summary from the TLDR AI newsletter

ZML is a lightning fast inference engine written in Zig that is designed with performance in mind. It can be used for a variety of models, although it requires some customization to get working for a new architecture.