BATCH LORAS ON THE SAME GPU

Summary from the TLDR AI newsletter

LoRAs are small parameter adapters that change the behavior of the underlying model by plugging into certain layers. You can batch generation for the base model to improve performance. Additionally, you can batch LoRA-modified versions of the model and serve models with different performance to different users.