vllm/v1/worker/gpu_input_batch.py · cd4a72a28d32851c7d188ee4f0a0145f4250e2aa · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1][Spec decode] Move drafter to model runner (#13363) · cd4a72a2
Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
cd4a72a2

gpu_input_batch.py 23 KB