LEMONADE

Summary from the TLDR AI newsletter

Lemonade is a server that helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPUs. It supports both GGUF and ONNX models - Lemonade has a Model Manager that allows users to import custom models. Lemonade makes it easy to switch between configurations at runtime. It can be used with any OpenAI-compatible client library.