vllm/spec_decode/spec_decode_worker.py · f525c0be8b4c9ede079f866721526eba4c679ee3 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Model][Speculative Decoding] DeepSeek MTP spec decode (#12755) · f525c0be
Lucia Fang authored Feb 19, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
f525c0be

spec_decode_worker.py 61.2 KB