# LLM serving insights

Rangoon Insights reporting and guides tagged LLM serving.

Canonical: https://rangoon.ai/insights/tags/llm-serving/

## Topics
- [Agent systems](https://rangoon.ai/insights/topics/agents/): Agent runtimes, handoffs, tools, and the boundaries that make them reviewable.
- [Governance](https://rangoon.ai/insights/topics/governance/): Policy, identity, authorization, approvals, and evidence for consequential work.
- [Infrastructure](https://rangoon.ai/insights/topics/infrastructure/): Model serving, sandboxes, tool services, and deployment boundaries.
- [Models](https://rangoon.ai/insights/topics/models/): Inference choices, local serving, compatibility, and operational tradeoffs.

## Stories
- [vLLM V1 alpha made the serving engine’s internal loop a migration surface](https://rangoon.ai/insights/archive-vllm-v1-alpha-january-2025/)
  vLLM announced its V1 alpha on January 27, 2025 as a major core-architecture redesign, retaining an OpenAI-compatible API while changing execution internals.


## More information

- [Documentation index](https://rangoon.ai/llms.txt)
- [AI access and policies](https://rangoon.ai/ai/)
- [Source repository](https://github.com/hypler-dev/rangoon)