vllm/v1/worker/gpu_model_runner.py · edce722eaa5e9f0b97bea611531e3341ec2e2e71 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[torch.compile] Hide KV cache behind torch.compile boundary (#11677) · cf5f000d
Chen Zhang authored Jan 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
cf5f000d

gpu_model_runner.py 39.8 KB