vllm/v1/worker/tpu_model_runner.py · 9112b443a042d8d815880b8780633882ad32b183 · OpenDAS / vllm_cscc

[Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443

Siyuan Liu authored Jun 02, 2025


Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>

9112b443

tpu_model_runner.py 74.1 KB

Replace tpu_model_runner.py