examples/online_serving/token_generation_client.py · 6f1e7f7226447f606a0731376a2d0bd080aa2767 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

token_generation_client.py 1.33 KB