Merge branch 'v0.9.2-dev-ds-wm-1106' into 'v0.9.2-dev-ds'
[fix]解决同时开启chunked-prefill和并行解码出现的指标统计错误问题 See merge request dcutoolkit/deeplearing/vllm!243
Showing
Please register or sign in to comment
[fix]解决同时开启chunked-prefill和并行解码出现的指标统计错误问题 See merge request dcutoolkit/deeplearing/vllm!243