tests/spec_decode/test_ngram_worker.py · 9d43afcc538645625ea5fc2bca01d3697dd0595c · OpenDAS / vllm_cscc · GitLab

"vscode:/vscode.git/clone" did not exist on "f028dff33d3d0b0dfe71e0e0354b355b8232a4ec"

Find file Blame History Permalink

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291) · 9d43afcc
Nicolò Lucchesi authored Nov 07, 2024
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
9d43afcc

test_ngram_worker.py 7.04 KB