Update launcher to set local rank environ variable (#597)

* Update launch.py * formatting

Update launcher to set local rank environ variable (#597)
* Update launch.py * formatting
c5a449f9 · Jeff Rasley · GitHub · a4763f55 · c5a449f9
Unverified Commit c5a449f9 authored Dec 11, 2020 by Jeff Rasley Committed by GitHub Dec 11, 2020
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

deepspeed/launcher/launch.py deepspeed/launcher/launch.py +1 -0

No files found.
--- a/deepspeed/launcher/launch.py
+++ b/deepspeed/launcher/launch.py
@@ -113,6 +113,7 @@ def main():
        # each process's rank
        dist_rank = global_rank_mapping[local_node][local_rank]
        current_env["RANK"] = str(dist_rank)
+        current_env["LOCAL_RANK"] = str(local_rank)
        # spawn the processes
        cmd = [