lib/llm/src/block_manager/pool/managed/inactive.rs · 6271a31f0d3df374e02202cfd21ee7006c5baee5 · OpenDAS / dynamo

feat: Implement priority-based KV cache offload filtering (#5563) · 6271a31f

Yuewei Na authored Jan 29, 2026


Signed-off-by: Yuewei Na <248773860+nv-yna@users.noreply.github.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Signed-off-by: yna <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

6271a31f

inactive.rs 38.2 KB

Replace inactive.rs