Merge pull request #68 from serendipityCoding/fix-transformer-typo

Fix typo in transformer example

Merge pull request #68 from serendipityCoding/fix-transformer-typo
Fix typo in transformer example
8bd400d0 · Rick Ho · GitHub · 0ec96584 · 0ac24914 · 8bd400d0
Unverified Commit 8bd400d0 authored Aug 18, 2021 by Rick Ho Committed by GitHub Aug 18, 2021
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

examples/transformer-xl/mem_transformer.py examples/transformer-xl/mem_transformer.py +1 -1

No files found.
--- a/examples/transformer-xl/mem_transformer.py
+++ b/examples/transformer-xl/mem_transformer.py
@@ -513,7 +513,7 @@ class AdaptiveEmbedding(nn.Module):
                l_idx, r_idx = self.cutoff_ends[i], self.cutoff_ends[i+1]
                d_emb_i = d_embed // (div_val ** i)
                self.emb_layers.append(nn.Embedding(r_idx-l_idx, d_emb_i))
-                self.emb_projs.append(Projectio(d_proj, d_emb_i))
+                self.emb_projs.append(Projection(d_proj, d_emb_i))
    def forward(self, inp):
        if self.div_val == 1: