vllm/spec_decode/batch_expansion.py · 500b93c8dc84182776f17c3c31053aaba9865e8b · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix] Make spec. decode respect per-request seed. (#6034) · d4201e06
Thomas Parnell authored Jul 19, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
d4201e06

batch_expansion.py 16.8 KB