lib/llm/src/block_manager/offload.rs · 6271a31f0d3df374e02202cfd21ee7006c5baee5 · OpenDAS / dynamo

feat: Implement priority-based KV cache offload filtering (#5563) · 6271a31f

Yuewei Na authored Jan 29, 2026


Signed-off-by: Yuewei Na <248773860+nv-yna@users.noreply.github.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Signed-off-by: yna <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

6271a31f

offload.rs 95.6 KB

Replace offload.rs