"docker/Dockerfile.ppc64le" did not exist on "bd2107e30a258a5bcaa94e678a3890ec083a60a0"
Commit a6088d09 authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-wm-1106' into 'v0.9.2-dev'

[fix]解决同时开启chunked-prefill和并行解码出现的指标统计错误问题

See merge request dcutoolkit/deeplearing/vllm!244
parents 4bce8dab a14613a6
......@@ -1225,7 +1225,7 @@ class Scheduler(SchedulerInterface):
spec_decoding_stats = self.make_spec_decoding_stats(
spec_decoding_stats,
num_draft_tokens=len(scheduled_spec_token_ids),
num_accepted_tokens=len(generated_token_ids) - 1)
num_accepted_tokens=max(0, len(generated_token_ids) - 1))
# NOTE(woosuk): This has to be executed after updating
# `request.num_computed_tokens`.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment