vllm/spec_decode/spec_decode_worker.py · e7c7067b45c9f604e0c68015ee6e0fe345288111 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable... · e7c7067b
Cade Daniel authored Apr 09, 2024
```
[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable hardware-agnostic speculative decoding" (#3837)
```
e7c7067b

spec_decode_worker.py 15.7 KB