Skip to content

GitLab

Unverified Commit 8bb2c387 authored by Yih-Dar's avatar Yih-Dar Committed by GitHub
Browse files

Fix FlaxBigBirdEmbeddings (#17842) 


Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
parent b68d408f
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/models/big_bird/modeling_flax_big_bird.py
View file @ 8bb2c387
...@@ -229,8 +229,8 @@ class FlaxBigBirdEmbeddings(nn.Module): ...@@ -229,8 +229,8 @@ class FlaxBigBirdEmbeddings(nn.Module):
hidden_states = inputs_embeds + token_type_embeddings + position_embeds hidden_states = inputs_embeds + token_type_embeddings + position_embeds
# Layer Norm # Layer Norm
hidden_states = self.LayerNorm(hidden_states)
hidden_states = self.dropout(hidden_states, deterministic=deterministic) hidden_states = self.dropout(hidden_states, deterministic=deterministic)
hidden_states = self.LayerNorm(hidden_states)
return hidden_states return hidden_states
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment