"vscode:/vscode.git/clone" did not exist on "4011273a86e8eaab435d3e0965df79512b3813ca"
Unverified Commit c114a219 authored by vfdev's avatar vfdev Committed by GitHub
Browse files

[fix] fixed typo (#448)

parent b75a5e26
......@@ -54,7 +54,7 @@ def initialize_model_parallel(
Let's say we have a total of 8 GPUs denoted by g0 ... g7 and we
use 2 GPUs to parallelize the model. The present function will
create 4 model parallel groups and 2 data parallel grous as:
create 4 model parallel groups and 2 data parallel groups as:
4 model parallel groups:
[g0, g1], [g2, g3], [g4, g5], [g6, g7]
2 data parallel groups:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment