Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
dist_8gpus_zero1.yaml 315 Bytes
Newer Older
Zeqiang Lai's avatar
[Classification] support deepspeed, fix optimizer bugs #(83)  
Zeqiang Lai committed
1
2
3
4
5
6
7
8
9
10
11 
compute_environment: LOCAL_MACHINE
deepspeed_config:
  deepspeed_config_file: configs/accelerate/deepspeed/ds_config_zero1.json
  zero3_init_flag: false
distributed_type: DEEPSPEED
downcast_bf16: 'no'
machine_rank: 0
main_training_function: main
num_machines: 1
num_processes: 8
rdzv_backend: static
zhe chen's avatar
Use pre-commit to reformat code  
zhe chen committed
12 
use_cpu: false