tests/v1/e2e/test_ngram_spec_decode.py · 1e799b7ec1b1c61952d2ae24c85ecf3fcb0f6de3 · OpenDAS / vllm_cscc

[V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due... · 5c538c37

Benjamin Chislett authored Mar 12, 2025


[V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing (#14645)
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>

5c538c37

test_ngram_spec_decode.py 2.89 KB

Replace test_ngram_spec_decode.py