SGLANG

Summary from the TLDR newsletter

SGLang is a structured generation language designed for large language models that makes interacting with them faster and more controllable.