Skip to content

GitLab

Unverified Commit f002e9a8 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[Cleanup] Only log MoE DP setup warning if DP is enabled (#21315) 


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent a1f3610f
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 4 deletions
vllm/model_executor/layers/fused_moe/config.py
View file @ f002e9a8
...@@ -464,10 +464,11 @@ class FusedMoEConfig: ...@@ -464,10 +464,11 @@ class FusedMoEConfig:
) )
else: else:
_quant_config = FusedMoEQuantConfig() _quant_config = FusedMoEQuantConfig()
logger.warning_once("MoE DP setup unable to determine " if moe_parallel_config.dp_size > 1:
"quantization scheme or unsupported " logger.warning_once("MoE DP setup unable to determine "
"quantization type. This model will " "quantization scheme or unsupported "
"not run with DP enabled.") "quantization type. This model will "
"not run with DP enabled.")
else: else:
_quant_config = quant_config _quant_config = quant_config
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment