vllm/v1/worker/tpu_model_runner.py · eb5819b2d9ff4e5a019de97c333bbedf2a2def1a · OpenDAS / vllm_cscc

Nicolò Lucchesi authored Apr 17, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: Hyesoo Yang <hyeygit@gmail.com>

eb5819b2

tpu_model_runner.py 49.1 KB