Fix windows err with checkpoint race conditions (#28637)

Fix windows err

Fix windows err with checkpoint race conditions (#28637)
Fix windows err
582d104b · Zach Mueller · GitHub · c475eca9 · 582d104b
Unverified Commit 582d104b authored Jan 23, 2024 by Zach Mueller Committed by GitHub Jan 23, 2024
Show whitespace changes
Inline Side-by-side

Showing with 5 additions and 3 deletions

src/transformers/trainer.py src/transformers/trainer.py +5 -3

No files found.
--- a/src/transformers/trainer.py
+++ b/src/transformers/trainer.py
@@ -2415,6 +2415,8 @@ class Trainer:
                    os.rename(staging_output_dir, output_dir)

                    # Ensure rename completed in cases where os.rename is not atomic
+                    # And can only happen on non-windows based systems
+                    if os.name != "nt":
                        fd = os.open(output_dir, os.O_RDONLY)
                        os.fsync(fd)
                        os.close(fd)