vllm/spec_decode/ngram_worker.py · afd0da2186c1d58fb48e138df0a2f548612b5d7d · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core] Interface for accessing model from `VllmRunner` (#10353) · 59a0192f
Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
59a0192f

ngram_worker.py 7.53 KB