vllm/v1/spec_decode/ngram_proposer.py · dcb5624aa2460d62ca09304a053a98ec633b0f79 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1][Spec Decode] Handle draft tokens beyond max_model_len (#16087) · 3a0fba5c
Woosuk Kwon authored Apr 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
3a0fba5c

ngram_proposer.py 4.13 KB