Research Intelligence Mate ReviewsBriefingsTopics Sign in Request access
Topics · Optimizing AI Systems

LLM Serving and Inference Scheduling

Batching, routing, admission control, prefill/decode scheduling, SLO-aware serving, and throughput optimization

Track this topic →
Living review: Optimizing AI Systems
70 recent papers · updated 2026-09-08
Read the review →
Related topics in Optimizing AI Systems
Queueing and Flow Control for LLM Systems KV Cache and Memory Optimization GPU and Cluster Scheduling Agentic Workflow Orchestration Inference-Time Compute Allocation Model Routing and Cascades