KV eviction, prefix caching, memory allocation, disaggregated serving, and long-context resource control