docs/source/usage/spec_decode.rst · 4d3a2c284ecc47748273664c9a6ef302ff3adcbe · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Doc] Explicitly state that PP isn't compatible with speculative decoding yet (#10975) · c889d588
Cyrus Leung authored Dec 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c889d588

spec_decode.rst 9.01 KB