Research Intelligence Mate ReviewsBriefingsTopics Sign in Request access
Topics · Optimizing AI Systems

Queueing and Flow Control for LLM Systems

Queueing-theoretic models, stability guarantees, request admission, latency control, and traffic shaping for LLM workloads

Track this topic →
Living review: Optimizing AI Systems
68 recent papers · updated 2026-09-03
Read the review →
Related topics in Optimizing AI Systems
LLM Serving and Inference Scheduling KV Cache and Memory Optimization GPU and Cluster Scheduling Agentic Workflow Orchestration Inference-Time Compute Allocation Model Routing and Cascades