vllm/entrypoints/llm.py · 466166dcfdc40f85f4043a94b9a53099af4a0850 · OpenDAS / vllm_cscc

[Frontend] Add optional token-level progress bar to `LLM.beam_search` (#19301) · 466166dc

NekoMimiUnagi authored Jun 19, 2025


Signed-off-by: Ruosen Li <rxl190028@utdallas.edu>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Ubuntu <ubuntu@ip-172-31-71-179.ec2.internal>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

466166dc

llm.py 69.1 KB

Replace llm.py