"ssh:/git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "c4d62618ca7cf8507c1e357fa1180fb162c670fa"
Unverified Commit 73ae0b44 authored by Yuchen Yan's avatar Yuchen Yan Committed by GitHub
Browse files

[Bugfix] Fix tqdm progress bar when SamplingParams.n > 1 (#12428)


Signed-off-by: default avatarYuchen Yan <740987012@qq.com>
parent 6d7f0377
...@@ -1394,7 +1394,9 @@ class LLM: ...@@ -1394,7 +1394,9 @@ class LLM:
pbar.postfix = ( pbar.postfix = (
f"est. speed input: {in_spd:.2f} toks/s, " f"est. speed input: {in_spd:.2f} toks/s, "
f"output: {out_spd:.2f} toks/s") f"output: {out_spd:.2f} toks/s")
pbar.update(1) pbar.update(len(output.outputs))
else:
pbar.update(1)
if use_tqdm: if use_tqdm:
pbar.close() pbar.close()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment