vllm/engine/arg_utils.py · 61c299f81fdf4df30f699a5030f1eb4b10d0cdba · OpenDAS / vllm_cscc

[Misc]add configurable cuda graph size (#17201) · 61c299f8

Chen Xia authored May 01, 2025


Signed-off-by: CXIAAAAA <cxia0209@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

61c299f8

arg_utils.py 69.6 KB

Replace arg_utils.py