vllm/executor/gpu_executor.py · 7187507301aa8361407e04be42d0d50680891493 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Speculative decoding][Re-take] Enable TP>1 speculative decoding (#4840) · 973617ae
Cody Yu authored May 16, 2024
```
Co-authored-by: Cade Daniel <edacih@gmail.com>
Co-authored-by: Cade Daniel <cade@anyscale.com>
```
973617ae

gpu_executor.py 4.56 KB