Skip to content

GitLab

Unverified Commit b3544e4c authored by Guillaume Filion's avatar Guillaume Filion Committed by GitHub
Browse files

Return global attentions (see #7514) (#10906)

parent 4f21e1dd
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
src/transformers/models/longformer/modeling_longformer.py
View file @ b3544e4c
...@@ -1786,6 +1786,7 @@ class LongformerForMaskedLM(LongformerPreTrainedModel): ...@@ -1786,6 +1786,7 @@ class LongformerForMaskedLM(LongformerPreTrainedModel):
logits=prediction_scores, logits=prediction_scores,
hidden_states=outputs.hidden_states, hidden_states=outputs.hidden_states,
attentions=outputs.attentions, attentions=outputs.attentions,
global_attentions=outputs.global_attentions,
) )
...@@ -1878,6 +1879,7 @@ class LongformerForSequenceClassification(LongformerPreTrainedModel): ...@@ -1878,6 +1879,7 @@ class LongformerForSequenceClassification(LongformerPreTrainedModel):
logits=logits, logits=logits,
hidden_states=outputs.hidden_states, hidden_states=outputs.hidden_states,
attentions=outputs.attentions, attentions=outputs.attentions,
global_attentions=outputs.global_attentions,
) )
...@@ -2126,6 +2128,7 @@ class LongformerForTokenClassification(LongformerPreTrainedModel): ...@@ -2126,6 +2128,7 @@ class LongformerForTokenClassification(LongformerPreTrainedModel):
logits=logits, logits=logits,
hidden_states=outputs.hidden_states, hidden_states=outputs.hidden_states,
attentions=outputs.attentions, attentions=outputs.attentions,
global_attentions=outputs.global_attentions,
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment