vllm/v1/spec_decode/ngram_proposer.py · b9bd76ca14bca7ddb912e65c8aa45a8044869f1b · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1][Spec Decode] Respect prompt_lookup_max (#15348) · b9bd76ca
Woosuk Kwon authored Mar 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
b9bd76ca

ngram_proposer.py 3.4 KB