vllm/v1/worker/tpu_model_runner.py · e588ac237ca52fc8c5c3e18b85972a8b3a0262db · OpenDAS / vllm_cscc

Woosuk Kwon authored Mar 20, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

0c6f5023

tpu_model_runner.py 42.2 KB