vllm/v1/worker/gpu_model_runner.py · 8d6cf89526ff983b7eb74aad3903138004ae95cd · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] [Spec Decode] Support random sampling for spec decode (#13933) · 8d6cf895
Lily Liu authored Mar 16, 2025
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
8d6cf895

gpu_model_runner.py 69.8 KB