vllm/v1/worker/gpu_model_runner.py · 1f55e0571350f3dd2c04638e13e52d8ed557d93e · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Enable Inductor when using piecewise CUDA graphs (#10268) · 1f55e057
Woosuk Kwon authored Nov 12, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
1f55e057

gpu_model_runner.py 31.3 KB