Skip to content

GitLab

Unverified Commit 180c6de6 authored by Jake Tae's avatar Jake Tae Committed by GitHub
Browse files

docs: fix minor typo (#13289) 

`at` should be `a1`
parent 066fd047
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
docs/source/parallelism.md
View file @ 180c6de6
...@@ -58,7 +58,7 @@ a0 | b0 | c0 ...@@ -58,7 +58,7 @@ a0 | b0 | c0
a1 | b1 | c1 a1 | b1 | c1
a2 | b2 | c2 a2 | b2 | c2
``` ```
Layer La has weights a0, at and a2. Layer La has weights a0, a1 and a2.
If we have 3 GPUs, the Sharded DDP (= Zero-DP) splits the model onto 3 GPUs like so: If we have 3 GPUs, the Sharded DDP (= Zero-DP) splits the model onto 3 GPUs like so:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment