vllm/spec_decode/spec_decode_worker.py · 2bc3fbba0cf5b07fabb798d41b153b895d30c7b4 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core] Interface for accessing model from `VllmRunner` (#10353) · 59a0192f
Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
59a0192f

spec_decode_worker.py 54.4 KB