vllm/v1/worker/gpu_model_runner.py · e18227b04a7ef082e55380e143ae9e56f1dc6f86 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1][PP] Cache Intermediate Tensors (#13353) · e18227b0
Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
e18227b0

gpu_model_runner.py 64.4 KB