🚨🚨🚨 Use default ignore index in Luke (#23014)

Use default ignore index in Luke

🚨🚨🚨 Use default ignore index in Luke (#23014)
Use default ignore index in Luke
0083b149 · Sylvain Gugger · GitHub · 8b129030 · 0083b149
Unverified Commit 0083b149 authored Apr 26, 2023 by Sylvain Gugger Committed by GitHub Apr 26, 2023
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

src/transformers/models/luke/modeling_luke.py src/transformers/models/luke/modeling_luke.py +1 -1

No files found.
--- a/src/transformers/models/luke/modeling_luke.py
+++ b/src/transformers/models/luke/modeling_luke.py
@@ -1298,7 +1298,7 @@ class LukeForMaskedLM(LukePreTrainedModel):
        self.lm_head = LukeLMHead(config)
        self.entity_predictions = EntityPredictionHead(config)

-        self.loss_fn = nn.CrossEntropyLoss(ignore_index=-1)
+        self.loss_fn = nn.CrossEntropyLoss()

        # Initialize weights and apply final processing
        self.post_init()