vllm/v1/worker/gpu_model_runner.py · 47539cfd3e5006159e427ee5bc32823f6cef7ec3 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783) · 66b58402
Vensen authored Nov 30, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
66b58402

gpu_model_runner.py 230 KB