Unverified Commit ec28784f authored by rasmith's avatar rasmith Committed by GitHub
Browse files

[CI][AMD]Bugfix] Check that model_config is not None in enable_norm_pad_fusion (#34007)


Signed-off-by: default avatarRandall Smith <Randall.Smith@amd.com>
parent 55aeec04
...@@ -109,6 +109,7 @@ def enable_norm_pad_fusion(cfg: "VllmConfig") -> bool: ...@@ -109,6 +109,7 @@ def enable_norm_pad_fusion(cfg: "VllmConfig") -> bool:
envs.VLLM_ROCM_USE_AITER envs.VLLM_ROCM_USE_AITER
and envs.VLLM_ROCM_USE_AITER_RMSNORM and envs.VLLM_ROCM_USE_AITER_RMSNORM
and envs.VLLM_ROCM_USE_AITER_TRITON_GEMM and envs.VLLM_ROCM_USE_AITER_TRITON_GEMM
and cfg.model_config is not None
and cfg.model_config.get_hidden_size() == 2880 and cfg.model_config.get_hidden_size() == 2880
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment