vllm/executor/cpu_executor.py · 08ccee1e830d39ecdb3c6cf382c843dbf5ae830e · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable... · e7c7067b
Cade Daniel authored Apr 09, 2024
```
[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable hardware-agnostic speculative decoding" (#3837)
```
e7c7067b

cpu_executor.py 5.37 KB