# KV cache insights

Rangoon Insights reporting and guides tagged KV cache.

Canonical: https://rangoon.ai/insights/tags/kv-cache/

## Topics
- [Agent systems](https://rangoon.ai/insights/topics/agents/): Agent runtimes, handoffs, tools, and the boundaries that make them reviewable.
- [Governance](https://rangoon.ai/insights/topics/governance/): Policy, identity, authorization, approvals, and evidence for consequential work.
- [Infrastructure](https://rangoon.ai/insights/topics/infrastructure/): Model serving, sandboxes, tool services, and deployment boundaries.
- [Models](https://rangoon.ai/insights/topics/models/): Inference choices, local serving, compatibility, and operational tradeoffs.

## Stories
- [NVIDIA’s memory codesign post highlights a practical boundary between capacity and usable agent throughput](https://rangoon.ai/insights/nvidia-memory-full-stack-codesign-2026/)
  NVIDIA’s November memory overview frames HBM, KV cache and retrieval data as a hierarchy; operators still need workload-level measurement before capacity claims.
- [NVIDIA Dynamo replaced the unsupported Docker Sandboxes prompt with a verifiable reasoning-models inference event](https://rangoon.ai/insights/archive-nvidia-dynamo-inference-march-2025/)
  NVIDIA introduced Dynamo in March 2025 as open-source inference-serving software, offering a documented replacement for an unsupported Docker Sandboxes historical event.
- [SGLang 0.4 made scheduling overlap, cache locality and constrained output distinct performance claims](https://rangoon.ai/insights/archive-sglang-04-december-2024/)
  SGLang released v0.4 on December 4, 2024 with a zero-overhead batch scheduler, cache-aware load balancing, DeepSeek attention work and xgrammar structured output.


## More information

- [Documentation index](https://rangoon.ai/llms.txt)
- [AI access and policies](https://rangoon.ai/ai/)
- [Source repository](https://github.com/hypler-dev/rangoon)