vllm/entrypoints/openai/serving_engine.py · 114b0e25004b7e7cf0a23dc65f407471bd5de7e8 · OpenDAS / vllm_cscc

[Frontend] Optimize beam search loop by sorting and then splicing (#19347) · 56f45edd

rookie authored Nov 21, 2025


Signed-off-by: zhangguozhu <zhangguozhu@360.cn>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: zhangguozhu <zhangguozhu@360.cn>
Co-authored-by: mgoin <mgoin64@gmail.com>

56f45edd

serving_engine.py 51.1 KB

Replace serving_engine.py