vllm/v1/worker/gpu_model_runner.py · 1da8f0e1dddaf8625829e7ecca7fce93eb685c03 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Use input_ids as input for text-only models (#11032) · d643c2ab
Woosuk Kwon authored Dec 11, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
d643c2ab

gpu_model_runner.py 28.2 KB