Back compatibility of checkpoints: don't rename model_parallel_rng_tracker

e805f0bd · Deepak Narayanan · 275d4e64 · e805f0bd
Commit e805f0bd authored Oct 22, 2020 by Deepak Narayanan
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

megatron/mpu/random.py megatron/mpu/random.py +1 -1

No files found.
--- a/megatron/mpu/random.py
+++ b/megatron/mpu/random.py
@@ -34,7 +34,7 @@ from .initialize import get_tensor_model_parallel_world_size


 # Default name for the model parallel rng tracker.
-_MODEL_PARALLEL_RNG_TRACKER_NAME = 'tensor-model-parallel-rng'
+_MODEL_PARALLEL_RNG_TRACKER_NAME = 'model-parallel-rng'


 # Whether apply model parallelsim to checkpointed hidden states.