Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
a65607d4
Commit
a65607d4
authored
Dec 17, 2024
by
wxj
Browse files
Update README.md
parent
e7da80dd
Pipeline
#2113
failed with stages
in 0 seconds
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
21 additions
and
0 deletions
+21
-0
README.md
README.md
+21
-0
No files found.
README.md
View file @
a65607d4
...
...
@@ -14,6 +14,27 @@
-
[
Llama预训练
](
###Llama预训练
)
-
[
参考
](
#参考
)
# 更新日志
2024.
12.16适配了torch prof
使用方法: 启动脚本中添加下列参数, 即可采集对应的prof信息
```
bash
PROFILE_ARGS
=(
--profile
# 开启profile
--profile-step-start
4
# skip前3个iter, warm第4个iter
--profile-step-end
5
# 采集第5个iter
--use-pytorch-profiler
# 使用torch prof
--profile-ranks
0 3
# 采集全局rank 第0和3
--profile-dir
./prof_data
# prof文件的保存目录
)
APP
=
"...
\
${
PROFILE_ARGS
[@]
}
\
"
${
APP
}
```
# 环境配置
1.
安装基础依赖包
<pre>
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment