Research Intelligence Mate ReviewsBriefingsTopics Sign in Request access
Topics · OR for Generative AI

LLM Serving and Inference Scheduling

Batching, routing, admission control, prefill/decode scheduling, SLO-aware serving, and throughput optimization

Track this topic →
Living review: OR for Generative AI
35 recent papers · updated 2026-04-26
Read the review →
Recent briefings
2026-04-21 — Weekly Research Intelligence — OR for Generative AI
2026-04-14 — Weekly Research Intelligence — OR for Generative AI
2026-04-07 — Weekly Research Intelligence — OR for Generative AI
2026-03-31 — Weekly Research Intelligence — OR for Generative AI
2026-03-24 — Weekly Research Intelligence — OR for Generative AI
Related topics in OR for Generative AI
Queueing and Flow Control for LLM Systems KV Cache and Memory Optimization GPU and Cluster Scheduling Agentic Workflow Orchestration Inference-Time Compute Allocation Model Routing and Cascades