Launch preview · The control plane for governed AI.Built in the open

Rangoon.si by Hypler

Evaluate software

Insight tag

SGLang

2 related stories.

Stories

Original explanatory diagram

News analysisRelease: August 23, 2025Published: October 24, 20263 min read

SGLang AI inference inference runtime open source

SGLang 0.5.1 added cache and scheduling work to its serving release

SGLang released version 0.5.1 on August 23, 2025, including HiCache NIXL connector work, CUDA-graph capture changes and new runtime integrations.

Original explanatory diagram

News analysisRelease: December 4, 2024Published: October 23, 20263 min read

SGLang LLM inference structured output KV cache

SGLang 0.4 made scheduling overlap, cache locality and constrained output distinct performance claims

SGLang released v0.4 on December 4, 2024 with a zero-overhead batch scheduler, cache-aware load balancing, DeepSeek attention work and xgrammar structured output.