Fix eval accumulation when `accelerate` > 0.20.3 (#26060)
As mentioned in: https://github.com/huggingface/transformers/issues/25641 Eval accumulation will never happen with `accelerate > 0.20.3`, so this change ensures that `sync_gradients` is ignored if accelerate is > 0.20.3
Showing
Please register or sign in to comment