Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen2_pytorch
Commits
2d7aa972
Commit
2d7aa972
authored
Sep 12, 2024
by
luopl
Browse files
Delete deepspeed.json
parent
1c31afaf
Pipeline
#1687
failed with stages
in 0 seconds
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
36 deletions
+0
-36
LLaMA-Factory/deepspeed.json
LLaMA-Factory/deepspeed.json
+0
-36
No files found.
LLaMA-Factory/deepspeed.json
deleted
100644 → 0
View file @
1c31afaf
{
"train_micro_batch_size_per_gpu"
:
"auto"
,
"zero_allow_untested_optimizer"
:
true
,
"fp16"
:
{
"enabled"
:
true
,
"loss_scale"
:
0
,
"initial_scale_power"
:
11
,
"loss_scale_window"
:
1000
,
"hysteresis"
:
2
,
"min_loss_scale"
:
1
},
"zero_optimization"
:
{
"stage"
:
3
,
"allgather_partitions"
:
true
,
"allgather_bucket_size"
:
5e8
,
"overlap_comm"
:
false
,
"reduce_scatter"
:
true
,
"reduce_bucket_size"
:
5e8
,
"contiguous_gradients"
:
true
,
"offload_optimizer"
:
{
"device"
:
"cpu"
,
"pin_memory"
:
true
},
"offload_param"
:
{
"device"
:
"cpu"
,
"pin_memory"
:
true
}
},
"gradient_accumulation_steps"
:
"auto"
,
"gradient_clipping"
:
"auto"
,
"steps_per_print"
:
2000
,
"train_batch_size"
:
"auto"
,
"train_micro_batch_size_per_gpu"
:
1
,
"wall_clock_breakdown"
:
false
}
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment