Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ColossalAI
Commits
039854b3
Commit
039854b3
authored
Jun 08, 2023
by
Maruyama_Aya
Browse files
modify shell for check
parent
cf4792c9
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
4 additions
and
4 deletions
+4
-4
examples/images/dreambooth/test_ci.sh
examples/images/dreambooth/test_ci.sh
+3
-3
examples/images/dreambooth/train_dreambooth_colossalai.py
examples/images/dreambooth/train_dreambooth_colossalai.py
+1
-1
No files found.
examples/images/dreambooth/test_ci.sh
View file @
039854b3
...
@@ -6,8 +6,8 @@ HF_DATASETS_OFFLINE=1
...
@@ -6,8 +6,8 @@ HF_DATASETS_OFFLINE=1
TRANSFORMERS_OFFLINE
=
1
TRANSFORMERS_OFFLINE
=
1
DIFFUSERS_OFFLINE
=
1
DIFFUSERS_OFFLINE
=
1
# "torch_ddp" "torch_ddp_fp16"
# "torch_ddp" "torch_ddp_fp16"
"low_level_zero"
for
plugin
in
"low_level_zero"
"gemini"
;
do
for
plugin
in
"gemini"
;
do
torchrun
--nproc_per_node
4
--standalone
train_dreambooth_colossalai.py
\
torchrun
--nproc_per_node
4
--standalone
train_dreambooth_colossalai.py
\
--pretrained_model_name_or_path
=
"/data/dreambooth/diffuser/stable-diffusion-v1-4"
\
--pretrained_model_name_or_path
=
"/data/dreambooth/diffuser/stable-diffusion-v1-4"
\
--instance_data_dir
=
"/data/dreambooth/Teyvat/data"
\
--instance_data_dir
=
"/data/dreambooth/Teyvat/data"
\
...
@@ -20,5 +20,5 @@ for plugin in "low_level_zero" "gemini"; do
...
@@ -20,5 +20,5 @@ for plugin in "low_level_zero" "gemini"; do
--lr_scheduler
=
"constant"
\
--lr_scheduler
=
"constant"
\
--lr_warmup_steps
=
0
\
--lr_warmup_steps
=
0
\
--num_class_images
=
200
\
--num_class_images
=
200
\
--placement
=
"cuda"
--placement
=
"cpu"
#
"cuda"
done
done
examples/images/dreambooth/train_dreambooth_colossalai.py
View file @
039854b3
...
@@ -487,7 +487,7 @@ def main(args):
...
@@ -487,7 +487,7 @@ def main(args):
if
args
.
plugin
.
startswith
(
'torch_ddp'
):
if
args
.
plugin
.
startswith
(
'torch_ddp'
):
plugin
=
TorchDDPPlugin
()
plugin
=
TorchDDPPlugin
()
elif
args
.
plugin
==
'gemini'
:
elif
args
.
plugin
==
'gemini'
:
plugin
=
GeminiPlugin
(
placement_policy
=
'cuda'
,
strict_ddp_mode
=
True
,
initial_scale
=
2
**
5
)
plugin
=
GeminiPlugin
(
placement_policy
=
args
.
placement
,
strict_ddp_mode
=
True
,
initial_scale
=
2
**
5
)
elif
args
.
plugin
==
'low_level_zero'
:
elif
args
.
plugin
==
'low_level_zero'
:
plugin
=
LowLevelZeroPlugin
(
initial_scale
=
2
**
5
)
plugin
=
LowLevelZeroPlugin
(
initial_scale
=
2
**
5
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment