TLDR AI · ENGINEERING & RESOURCES

MULTILORA INFERENCE SERVER

github.comGitHub repository

Summary from the TLDR AI newsletter

Lorax is an inference server that supports hot-swapping LoRAs onto a single base model. This means a dramatic decrease in RAM while supporting a wide range of model tunes.