Skip to content

GitLab

Unverified Commit f002e9a8 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[Cleanup] Only log MoE DP setup warning if DP is enabled (#21315) 


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent a1f3610f
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 4 deletions
vllm/model_executor/layers/fused_moe/config.py
View file @ f002e9a8
......@@ -464,10 +464,11 @@ class FusedMoEConfig:
)
else:
_quant_config = FusedMoEQuantConfig()
logger.warning_once("MoE DP setup unable to determine "
"quantization scheme or unsupported "
"quantization type. This model will "
"not run with DP enabled.")
if moe_parallel_config.dp_size > 1:
logger.warning_once("MoE DP setup unable to determine "
"quantization scheme or unsupported "
"quantization type. This model will "
"not run with DP enabled.")
else:
_quant_config = quant_config
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment