"docs/source/it/preprocessing.mdx" did not exist on "01b8cd59324565a713a736fe77bc2bd9d60494cb"
Unverified Commit 61d7fec8 authored by Stas Bekman's avatar Stas Bekman Committed by GitHub
Browse files

[bloom] gradient_checkpointing fix (#21655)

Update modeling_bloom.py
parent 0f96c26d
...@@ -774,6 +774,7 @@ class BloomModel(BloomPreTrainedModel): ...@@ -774,6 +774,7 @@ class BloomModel(BloomPreTrainedModel):
hidden_states, hidden_states,
alibi, alibi,
causal_mask, causal_mask,
layer_past,
head_mask[i], head_mask[i],
) )
else: else:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment