Skip to content

GitLab

Commit e805f0bd authored by Deepak Narayanan's avatar Deepak Narayanan
Browse files

Back compatibility of checkpoints: don't rename model_parallel_rng_tracker

parent 275d4e64
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
megatron/mpu/random.py
View file @ e805f0bd
...@@ -34,7 +34,7 @@ from .initialize import get_tensor_model_parallel_world_size ...@@ -34,7 +34,7 @@ from .initialize import get_tensor_model_parallel_world_size
# Default name for the model parallel rng tracker. # Default name for the model parallel rng tracker.
_MODEL_PARALLEL_RNG_TRACKER_NAME = 'tensor-model-parallel-rng' _MODEL_PARALLEL_RNG_TRACKER_NAME = 'model-parallel-rng'
# Whether apply model parallelsim to checkpointed hidden states. # Whether apply model parallelsim to checkpointed hidden states.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment