vllm/v1/worker/gpu_model_runner.py · faa02757307583f2c5557ff23cb41f1db4f1f29c · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Optimize the overhead of rewinding (#14905) · faa02757
Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
faa02757

gpu_model_runner.py 69 KB