TLDR AI · ENGINEERING & RESOURCES
MULTILORA INFERENCE SERVER
Summary from the TLDR AI newsletter
Lorax is an inference server that supports hot-swapping LoRAs onto a single base model. This means a dramatic decrease in RAM while supporting a wide range of model tunes.