Research Intelligence Mate ReviewsBriefingsTopics Sign in Request access
Topics · OR for Generative AI

Queueing and Flow Control for LLM Systems

Queueing-theoretic models, stability guarantees, request admission, latency control, and traffic shaping for LLM workloads

Track this topic →
Living review: OR for Generative AI
35 recent papers · updated 2026-04-26
Read the review →
Recent briefings
2026-04-21 — Weekly Research Intelligence — OR for Generative AI
2026-04-14 — Weekly Research Intelligence — OR for Generative AI
2026-04-07 — Weekly Research Intelligence — OR for Generative AI
2026-03-31 — Weekly Research Intelligence — OR for Generative AI
2026-03-24 — Weekly Research Intelligence — OR for Generative AI
Related topics in OR for Generative AI
LLM Serving and Inference Scheduling KV Cache and Memory Optimization GPU and Cluster Scheduling Agentic Workflow Orchestration Inference-Time Compute Allocation Model Routing and Cascades