vllm/spec_decode/multi_step_worker.py · 0c63c34f725f0b519fa094fbeca6e3cf12c911c1 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix][SpecDecode] kv corruption with bonus tokens in spec decode (#9730) · 0c63c34f
Sungjae Lee authored Nov 06, 2024
```
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
0c63c34f

multi_step_worker.py 17.2 KB