vllm/v1/worker/gpu_input_batch.py · 6faec545057e6152e92e8ab619fc018e20864943 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Do not store `None` in self.generators (#11038) · 6faec545
Woosuk Kwon authored Dec 09, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
6faec545

gpu_input_batch.py 10.3 KB