vllm/spec_decode/spec_decode_worker.py · 15aba081f33e6d048422df6dcdb94301d08d13e6 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Speculative Decoding] MLPSpeculator Tensor Parallel support (1/2) (#6050) · 15aba081
Sirej Dua authored Jul 02, 2024
```
Co-authored-by: Sirej Dua <sirej.dua@databricks.com>
Co-authored-by: Sirej Dua <Sirej Dua>
```
15aba081

spec_decode_worker.py 30.3 KB