vllm/spec_decode/spec_decode_worker.py · d4201e06d5ec3384e06b20816ad6b2f1d1fb1441 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix] Make spec. decode respect per-request seed. (#6034) · d4201e06
Thomas Parnell authored Jul 19, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
d4201e06

spec_decode_worker.py 33.5 KB