Skip to content

GitLab

Unverified Commit 3a391812 authored by Lzhang-hub's avatar Lzhang-hub Committed by GitHub
Browse files

fix bench serving bug (#4135)

parent 800bf018
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/bench_serving.py
View file @ 3a391812
...@@ -220,7 +220,7 @@ async def async_request_openai_completions( ...@@ -220,7 +220,7 @@ async def async_request_openai_completions(
most_recent_timestamp = timestamp most_recent_timestamp = timestamp
generated_text += data["choices"][0]["text"] generated_text += data["choices"][0]["text"]
output_len = data.get("usage", {}).get( output_len = (data.get("usage") or {}).get(
"completion_tokens", output_len "completion_tokens", output_len
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment