Unverified Commit 61d7fec8 authored by Stas Bekman's avatar Stas Bekman Committed by GitHub
Browse files

[bloom] gradient_checkpointing fix (#21655)

Update modeling_bloom.py
parent 0f96c26d
......@@ -774,6 +774,7 @@ class BloomModel(BloomPreTrainedModel):
hidden_states,
alibi,
causal_mask,
layer_past,
head_mask[i],
)
else:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment