vllm/worker/cache_engine.py · e7c7067b45c9f604e0c68015ee6e0fe345288111 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable... · e7c7067b
Cade Daniel authored Apr 09, 2024
```
[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable hardware-agnostic speculative decoding" (#3837)
```
e7c7067b

cache_engine.py 3.83 KB