vllm/envs.py · ac3cd6e83c264255703651c085e567a684112938 · OpenDAS / vllm_cscc

[core] add bucket padding to tpu_model_runner (#14995) · ac3cd6e8

Chenyaaang authored Mar 25, 2025


Signed-off-by: Chenyaaang <llccyy1212@gmail.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>

ac3cd6e8

envs.py 27.6 KB

Replace envs.py