Unverified Commit c3540728 authored by Ye Cao's avatar Ye Cao Committed by GitHub
Browse files

[Minor] Fix the path typo in loader.py: save_sharded_states.py -> save_sharded_state.py (#5151)


Signed-off-by: default avatarYe Cao <caoye.cao@alibaba-inc.com>
parent f081c3ce
...@@ -386,7 +386,7 @@ class ShardedStateLoader(BaseModelLoader): ...@@ -386,7 +386,7 @@ class ShardedStateLoader(BaseModelLoader):
Model loader that directly loads each worker's model state dict, which Model loader that directly loads each worker's model state dict, which
enables a fast load path for large tensor-parallel models where each worker enables a fast load path for large tensor-parallel models where each worker
only needs to read its own shard rather than the entire checkpoint. See only needs to read its own shard rather than the entire checkpoint. See
`examples/save_sharded_states.py` for creating a sharded checkpoint. `examples/save_sharded_state.py` for creating a sharded checkpoint.
""" """
DEFAULT_PATTERN = "model-rank-{rank}-part-{part}.safetensors" DEFAULT_PATTERN = "model-rank-{rank}-part-{part}.safetensors"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment