Skip to content

GitLab

Unverified Commit b42e878e authored by Wentao Ye's avatar Wentao Ye Committed by GitHub
Browse files

[Bug] Fix dcp error message (#40053) 


Signed-off-by: default avataryewentao256 <zhyanwentao@126.com>
parent 7243e02a
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/worker/cp_utils.py
View file @ b42e878e
...@@ -33,7 +33,7 @@ def check_attention_cp_compatibility(vllm_config: VllmConfig) -> None: ...@@ -33,7 +33,7 @@ def check_attention_cp_compatibility(vllm_config: VllmConfig) -> None:
"implementations to return the softmax LSE during decode, " "implementations to return the softmax LSE during decode, "
f"but {layer_impl.__class__.__name__} does not. " f"but {layer_impl.__class__.__name__} does not. "
"Try a different backend by setting " "Try a different backend by setting "
"VLLM_ATTENTION_BACKEND or disable DCP." "--attention-backend or disable DCP."
) )
if pcp_size > 1: if pcp_size > 1:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment