vllm/v1/worker/gpu_model_runner.py · 25ebed2f8ca6d747d63f2be9ede023c561851ac8 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1][Minor] Cache np arange to reduce input preparation overhead (#11214) · 25ebed2f
Woosuk Kwon authored Dec 15, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
25ebed2f

gpu_model_runner.py 29.7 KB