Critical KV cache isolation vulnerability in SGLang impacts multi-tenant AI deployments
Cloudflare identified a security flaw in the SGLang inference engine that caused cross-request data exposure for the GLM-5.3 model. Requests exceeding the configured KV cache pool size were incorrectly handled, causing the decode node to generate responses using stale KV cache pages belonging to other users.