vllm/v1/worker/gpu_model_runner.py · 80e9afb5bc53a5ca9f2b229e46c3cdead2704f5c · OpenDAS / vllm_cscc

[V1][Core] Support for Structured Outputs (#12388) · 80e9afb5

Aaron Pham authored Mar 07, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

80e9afb5

gpu_model_runner.py 67.9 KB

Replace gpu_model_runner.py