vllm/core/evictor.py · 886936837ca89e5645bc1f71cc0e1492b65b1590 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Performance][Core] Optimize the performance of evictor v1 and v2 by applying... · 88693683
Sungjae Lee authored Dec 15, 2024
```
[Performance][Core] Optimize the performance of evictor v1 and v2 by applying a priority queue and lazy deletion (#7209)
```
88693683

evictor.py 5.31 KB