vllm/worker/tpu_worker.py · 2f77b6cfec32c8054f996aee4b021f511630ea6f · OpenDAS / vllm_cscc · GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "c9eef37f329c952df92d4c8f4aa23e616f183d04"

Find file Blame History Permalink

[TPU] Implement prefix caching for TPUs (#10307) · 2f77b6cf
Woosuk Kwon authored Nov 20, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
2f77b6cf

tpu_worker.py 12.6 KB