vllm/v1/worker/gpu_model_runner.py · 4c21ce9ebabcdd0892b5b213f04541ad86507a66 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Get input tokens from scheduler (#13339) · 4c21ce9e
Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
4c21ce9e

gpu_model_runner.py 63.1 KB