vllm/v1/worker/gpu_model_runner.py · 18a88fcccce73261d51a18aba17368236ceb2f8b · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Remove scheduling constraint on partial requests (#12674) · 18a88fcc
Woosuk Kwon authored Feb 04, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
18a88fcc

gpu_model_runner.py 51.8 KB