vllm/core/scheduler.py · cf2f084d56a1293cb08da2393984cdc7685ac019 · OpenDAS / vllm_cscc · GitLab

"vllm/model_executor/models/opt.py" did not exist on "e5464ee484450c2671dd0226516c99c60ce70d9d"

Find file Blame History Permalink

Dynamic scheduler delay to improve ITL performance (#3279) · cf2f084d
Thomas Parnell authored Mar 22, 2024
```
Co-authored-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
cf2f084d

scheduler.py 21.8 KB