Skip to content

GitLab

"git@developer.sourcefind.cn:OpenDAS/colossalai.git" did not exist on "db4cbdc7fb79ad2aa576d2e71759901e18cd5e1d"
Commit c97a3523 authored by shaoyuw's avatar shaoyuw
Browse files

fix: typo in comment of low_level_zero plugin

parent d1fcc0fa
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
colossalai/booster/plugin/low_level_zero_plugin.py
View file @ c97a3523
...@@ -226,7 +226,7 @@ class LowLevelZeroPlugin(DPPluginBase): ...@@ -226,7 +226,7 @@ class LowLevelZeroPlugin(DPPluginBase):
``` ```
Args: Args:
strage (int, optional): ZeRO stage. Defaults to 1. stage (int, optional): ZeRO stage. Defaults to 1.
precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'. precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'.
initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32. initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32.
min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1. min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment