Skip to content

GitLab

Unverified Commit de737866 authored by Suraj Patil's avatar Suraj Patil Committed by GitHub
Browse files

[CLIP] fix grad ckpt (#15789)

parent a3e607d1
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
src/transformers/models/clip/modeling_clip.py
View file @ de737866
...@@ -572,7 +572,7 @@ class CLIPEncoder(nn.Module): ...@@ -572,7 +572,7 @@ class CLIPEncoder(nn.Module):
output_attentions=output_attentions, output_attentions=output_attentions,
) )
hidden_states = layer_outputs[0] hidden_states = layer_outputs[0]
if output_attentions: if output_attentions:
all_attentions = all_attentions + (layer_outputs[1],) all_attentions = all_attentions + (layer_outputs[1],)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment