Removed unused fields in DistilBert TransformerBlock (#2710)

* Removed unused fields in DistilBert TransformerBlock

Removed unused fields in DistilBert TransformerBlock (#2710)
* Removed unused fields in DistilBert TransformerBlock
564fd75d · guillaume-be · GitHub · 889d3bfd · 564fd75d
Unverified Commit 564fd75d authored Feb 20, 2020 by guillaume-be Committed by GitHub Feb 20, 2020
Show whitespace changes
Inline Side-by-side

Showing with 0 additions and 5 deletions

src/transformers/modeling_distilbert.py src/transformers/modeling_distilbert.py +0 -5

No files found.
--- a/src/transformers/modeling_distilbert.py
+++ b/src/transformers/modeling_distilbert.py
@@ -217,11 +217,6 @@ class TransformerBlock(nn.Module):
    def __init__(self, config):
        super().__init__()

-        self.n_heads = config.n_heads
-        self.dim = config.dim
-        self.hidden_dim = config.hidden_dim
-        self.dropout = nn.Dropout(p=config.dropout)
-        self.activation = config.activation
        self.output_attentions = config.output_attentions

        assert config.dim % config.n_heads == 0