Skip to content

GitLab

Unverified Commit 0083b149 authored by Sylvain Gugger's avatar Sylvain Gugger Committed by GitHub
Browse files

🚨🚨🚨 Use default ignore index in Luke (#23014) 

Use default ignore index in Luke
parent 8b129030
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/models/luke/modeling_luke.py
View file @ 0083b149
...@@ -1298,7 +1298,7 @@ class LukeForMaskedLM(LukePreTrainedModel): ...@@ -1298,7 +1298,7 @@ class LukeForMaskedLM(LukePreTrainedModel):
self.lm_head = LukeLMHead(config) self.lm_head = LukeLMHead(config)
self.entity_predictions = EntityPredictionHead(config) self.entity_predictions = EntityPredictionHead(config)
self.loss_fn = nn.CrossEntropyLoss(ignore_index=-1) self.loss_fn = nn.CrossEntropyLoss()
# Initialize weights and apply final processing # Initialize weights and apply final processing
self.post_init() self.post_init()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment