Skip to content

GitLab

Unverified Commit c114a219 authored by vfdev's avatar vfdev Committed by GitHub
Browse files

[fix] fixed typo (#448)

parent b75a5e26
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
fairscale/nn/model_parallel/initialize.py
View file @ c114a219
...@@ -54,7 +54,7 @@ def initialize_model_parallel( ...@@ -54,7 +54,7 @@ def initialize_model_parallel(
Let's say we have a total of 8 GPUs denoted by g0 ... g7 and we Let's say we have a total of 8 GPUs denoted by g0 ... g7 and we
use 2 GPUs to parallelize the model. The present function will use 2 GPUs to parallelize the model. The present function will
create 4 model parallel groups and 2 data parallel grous as: create 4 model parallel groups and 2 data parallel groups as:
4 model parallel groups: 4 model parallel groups:
[g0, g1], [g2, g3], [g4, g5], [g6, g7] [g0, g1], [g2, g3], [g4, g5], [g6, g7]
2 data parallel groups: 2 data parallel groups:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment