Skip to content

GitLab

Unverified Commit 223050a1 authored by Charlene Yang's avatar Charlene Yang Committed by GitHub
Browse files

[C] Allow bias support for sm80/86/89 for cuDNN 9+ (#863) 



allow bias support for sm80/86/89 for cuDNN 9+
Signed-off-by: default avatarCharlene Yang <8636796+cyanguwa@users.noreply.github.com>
parent 66736890
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 1 deletion
transformer_engine/common/fused_attn/fused_attn.cpp
View file @ 223050a1
...@@ -148,7 +148,10 @@ NVTE_Fused_Attn_Backend nvte_get_fused_attn_backend( ...@@ -148,7 +148,10 @@ NVTE_Fused_Attn_Backend nvte_get_fused_attn_backend(
&& attn_mask_type != NVTE_Mask_Type::NVTE_PADDING_MASK && attn_mask_type != NVTE_Mask_Type::NVTE_PADDING_MASK
&& sm_arch_ == 90) && sm_arch_ == 90)
|| (bias_type == NVTE_Bias_Type::NVTE_POST_SCALE_BIAS || (bias_type == NVTE_Bias_Type::NVTE_POST_SCALE_BIAS
&& sm_arch_ == 90)))) && sm_arch_ == 90)))
|| ((cudnn_runtime_version >= 90000)
&& (bias_type == NVTE_Bias_Type::NVTE_POST_SCALE_BIAS
&& sm_arch_ >= 80)))
&& ((cudnn_runtime_version < 8906 && attn_mask_type == NVTE_Mask_Type::NVTE_CAUSAL_MASK) && ((cudnn_runtime_version < 8906 && attn_mask_type == NVTE_Mask_Type::NVTE_CAUSAL_MASK)
|| ((cudnn_runtime_version >= 8906) || ((cudnn_runtime_version >= 8906)
&& (attn_mask_type == NVTE_Mask_Type::NVTE_CAUSAL_MASK && (attn_mask_type == NVTE_Mask_Type::NVTE_CAUSAL_MASK
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment