Skip to content

GitLab

Unverified Commit 24cbf6bc authored by Patrick von Platen's avatar Patrick von Platen Committed by GitHub
Browse files

Update README.md

parent 7390d9de
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/research_projects/wav2vec2/README.md
View file @ 24cbf6bc
...@@ -193,7 +193,7 @@ It is recommended to pre-train Wav2Vec2 with Trainer + Deepspeed (please refer t ...@@ -193,7 +193,7 @@ It is recommended to pre-train Wav2Vec2 with Trainer + Deepspeed (please refer t
Here is an example of how you can use DeepSpeed ZeRO-2 to pretrain a small Wav2Vec2 model: Here is an example of how you can use DeepSpeed ZeRO-2 to pretrain a small Wav2Vec2 model:
``` ```
PYTHONPATH=../../../src deepspeed --num_gpus 2 run_pretrain.py \ PYTHONPATH=../../../src deepspeed --num_gpus 4 run_pretrain.py \
--output_dir="./wav2vec2-base-libri-100h" \ --output_dir="./wav2vec2-base-libri-100h" \
--num_train_epochs="3" \ --num_train_epochs="3" \
--per_device_train_batch_size="32" \ --per_device_train_batch_size="32" \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment