Multi-tenant LoRA serving · In development

One base model. Every tenant's adapter.

Many tenants share one base model and a small pool of GPUs, each with its own LoRA adapter. LoRAplex tries to send every request to a replica that already holds its adapter, then measures when that beats plain round-robin, and when it does not. The full write-up is on the way.