examples/online_serving/token_generation_client.py · 41199996658428e6780f99c1ffff3ecc3bc5cc91 · OpenDAS / vllm_cscc · GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "cf278ff3b231b4fca0232db2d1183427dbc200bb"

Find file Blame History Permalink

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

token_generation_client.py 1.33 KB