vllm/v1/worker/tpu_model_runner.py · f6b32efb7f08a58e06cfee87c3dd241962bce3e1 · OpenDAS / vllm_cscc

[V1] Scatter and gather placeholders in the model runner (#16076) · f2ebb6f5

Roger Wang authored Apr 07, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>

f2ebb6f5

tpu_model_runner.py 47.1 KB

Replace tpu_model_runner.py