Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
9d8e86df
Commit
9d8e86df
authored
Mar 20, 2025
by
silencealiang
Browse files
去掉同流变量
parent
899c20e8
Pipeline
#2566
passed with stage
Changes
5
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
1 addition
and
9 deletions
+1
-9
examples/gpt3/run_gpt_567B_1nodes.sh
examples/gpt3/run_gpt_567B_1nodes.sh
+0
-2
examples/gpt3/run_gpt_567B_multinodes.sh
examples/gpt3/run_gpt_567B_multinodes.sh
+0
-2
examples/gpt3/train_gpt_567B_1nodes.sh
examples/gpt3/train_gpt_567B_1nodes.sh
+1
-1
examples/mixtral/run_mixtral_8x7B_1nodes.sh
examples/mixtral/run_mixtral_8x7B_1nodes.sh
+0
-2
examples/mixtral/run_mixtral_8x7B_multinodes.sh
examples/mixtral/run_mixtral_8x7B_multinodes.sh
+0
-2
No files found.
examples/gpt3/run_gpt_567B_1nodes.sh
View file @
9d8e86df
...
@@ -2,8 +2,6 @@ for para in $*
...
@@ -2,8 +2,6 @@ for para in $*
do
do
if
[[
$para
==
--profiling
*
]]
;
then
if
[[
$para
==
--profiling
*
]]
;
then
profiling
=
${
para
#*=
}
profiling
=
${
para
#*=
}
export
GPU_FLUSH_ON_EXECUTION
=
1
export
HIP_DIRECT_DISPATCH
=
0
fi
fi
done
done
...
...
examples/gpt3/run_gpt_567B_multinodes.sh
View file @
9d8e86df
...
@@ -2,8 +2,6 @@ for para in $*
...
@@ -2,8 +2,6 @@ for para in $*
do
do
if
[[
$para
==
--profiling
*
]]
;
then
if
[[
$para
==
--profiling
*
]]
;
then
profiling
=
${
para
#*=
}
profiling
=
${
para
#*=
}
export
GPU_FLUSH_ON_EXECUTION
=
1
export
HIP_DIRECT_DISPATCH
=
0
fi
fi
done
done
...
...
examples/gpt3/train_gpt_567B_1nodes.sh
View file @
9d8e86df
...
@@ -109,7 +109,7 @@ TORCH_PROFIE_ARGS=(
...
@@ -109,7 +109,7 @@ TORCH_PROFIE_ARGS=(
--profile-ranks
0 1 2 3 4 5 6 7
--profile-ranks
0 1 2 3 4 5 6 7
--profile-step-start
3
--profile-step-start
3
--profile-step-end
4
--profile-step-end
4
--profile-dir
torch_prof_gpt_1nodes_tp2-pp1-ep8-ep_tp1
--profile-dir
torch_prof_gpt_1nodes_tp2-pp1-ep8-ep_tp1
-cp1
--use-pytorch-profiler
--use-pytorch-profiler
)
)
...
...
examples/mixtral/run_mixtral_8x7B_1nodes.sh
View file @
9d8e86df
...
@@ -2,8 +2,6 @@ for para in $*
...
@@ -2,8 +2,6 @@ for para in $*
do
do
if
[[
$para
==
--profiling
*
]]
;
then
if
[[
$para
==
--profiling
*
]]
;
then
profiling
=
${
para
#*=
}
profiling
=
${
para
#*=
}
export
GPU_FLUSH_ON_EXECUTION
=
1
export
HIP_DIRECT_DISPATCH
=
0
fi
fi
done
done
...
...
examples/mixtral/run_mixtral_8x7B_multinodes.sh
View file @
9d8e86df
...
@@ -2,8 +2,6 @@ for para in $*
...
@@ -2,8 +2,6 @@ for para in $*
do
do
if
[[
$para
==
--profiling
*
]]
;
then
if
[[
$para
==
--profiling
*
]]
;
then
profiling
=
${
para
#*=
}
profiling
=
${
para
#*=
}
export
GPU_FLUSH_ON_EXECUTION
=
1
export
HIP_DIRECT_DISPATCH
=
0
fi
fi
done
done
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment