Skip to content

GitLab

Commit 5b29cc13 authored by Bram Vanroy's avatar Bram Vanroy Committed by mcarilli
Browse files

add gelu activation to fp32 list (#564)

parent 95d6c007
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
apex/amp/lists/functional_overrides.py
View file @ 5b29cc13
...@@ -37,7 +37,8 @@ FP32_FUNCS = [ ...@@ -37,7 +37,8 @@ FP32_FUNCS = [
'softmin', 'softmin',
'log_softmax', 'log_softmax',
'softmax', 'softmax',
'gelu',
# Normalization # Normalization
'layer_norm', 'layer_norm',
'group_norm', 'group_norm',
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment