examples/offline_inference/disaggregated_prefill.py · 72a3f6b898d8397c406debc49593e15aa7cbb4bc · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

Construct `KVTransferConfig` properly from Python instead of using JSON blobs without CLI (#17994) · 72a3f6b8
Harry Mellor authored May 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
72a3f6b8

disaggregated_prefill.py 4.06 KB