vllm/compilation/backends.py · 661a34fd4fdd700a29b2db758e23e4e243e7ff18 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[v1][torch.compile] support managing cudagraph buffer (#10203) · 330e82d3
youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
330e82d3

backends.py 27.4 KB