Insight tag
6 related stories.
SGLang released version 0.5.1 on August 23, 2025, including HiCache NIXL connector work, CUDA-graph capture changes and new runtime integrations.
Read analysisOpenVINO 2025.1 was released on April 10, 2025 with GenAI integrations, token-eviction preview work and text-generation NPU acceleration claims.
Read analysisONNX Runtime 1.21.0 was released on March 8, 2025 with chat mode, decoder-pipeline work, WebGPU fixes and notable execution-provider changes.
Read analysisNVIDIA released TensorRT-LLM 0.17 on February 7, 2025 with scoped Blackwell support, NVFP4 work and an experimental PyTorch workflow.
Read analysisTriton 3.2.0 appeared on PyPI on January 22, 2025, with five Linux x86-64 wheels for CPython 3.9 through 3.13 and a matching promotion tag.
Read analysisvLLM announced its V1 alpha on January 27, 2025 as a major core-architecture redesign, retaining an OpenAI-compatible API while changing execution internals.
Read analysis
