vllm/worker/tpu_model_runner.py · 2f77b6cfec32c8054f996aee4b021f511630ea6f · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[TPU] Implement prefix caching for TPUs (#10307) · 2f77b6cf
Woosuk Kwon authored Nov 20, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
2f77b6cf

tpu_model_runner.py 39 KB