vllm/v1/worker/gpu_model_runner.py · 140cbb118698b0f685f2a1ce2c348962636755c6 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix] Cuda Clean up scales Kvcache fp8/int8_per_token_head (#39224) · 140cbb11
JartX authored Apr 08, 2026
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
140cbb11

gpu_model_runner.py 303 KB