vllm/spec_decode/ngram_worker.py · e8937954434037ac787efa800f01d9d294185439 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[2/N] executor pass the complete config to worker/modelrunner (#9938) · e8937954
youkaichao authored Nov 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
e8937954

ngram_worker.py 7.33 KB