vllm/v1/worker/tpu_model_runner.py · c9b38be8aafb02b69ccb704b33d2bb4329fbb0e6 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Spec Decode] Make `propose_draft_token_ids` non-blocking for lower TTFT (#23041) · c9b38be8
Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
c9b38be8

tpu_model_runner.py 92.2 KB