Skip to content

GitLab

Unverified Commit 81ee91f2 authored by ppt0011's avatar ppt0011 Committed by GitHub
Browse files

Merge pull request #4858 from Shawlleyw/main 

[doc]: typo in document of booster low_level_zero plugin
parents d1fcc0fa c97a3523
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
colossalai/booster/plugin/low_level_zero_plugin.py
View file @ 81ee91f2
...@@ -226,7 +226,7 @@ class LowLevelZeroPlugin(DPPluginBase): ...@@ -226,7 +226,7 @@ class LowLevelZeroPlugin(DPPluginBase):
``` ```
Args: Args:
strage (int, optional): ZeRO stage. Defaults to 1. stage (int, optional): ZeRO stage. Defaults to 1.
precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'. precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'.
initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32. initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32.
min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1. min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment