vllm/v1/worker/tpu_model_runner.py · dd8a29da99aaca4aaedf710c813222871245e140 · OpenDAS / vllm_cscc

[core] add bucket padding to tpu_model_runner (#14995) · ac3cd6e8

Chenyaaang authored Mar 25, 2025


Signed-off-by: Chenyaaang <llccyy1212@gmail.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>

ac3cd6e8

tpu_model_runner.py 43.5 KB

Replace tpu_model_runner.py