Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
BLOOM_fastertransformer
Commits
21de54f8
Commit
21de54f8
authored
Oct 18, 2023
by
zhuwenwen
Browse files
Update README.md
parent
12deca5f
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
21de54f8
...
@@ -64,7 +64,7 @@ python ../examples/pytorch/gpt/utils/huggingface_bloom_convert.py \
...
@@ -64,7 +64,7 @@ python ../examples/pytorch/gpt/utils/huggingface_bloom_convert.py \
其中:
`--input-dir`
为模型输入路径,
`--output-dir`
为模型输出路径,
`-tp `
为推理的tp大小,
`--data-type`
为推理的数据类型,
`-p`
为转换时的并行线程数,
`-v`
为启用详细日志记录.
其中:
`--input-dir`
为模型输入路径,
`--output-dir`
为模型输出路径,
`-tp `
为推理的tp大小,
`--data-type`
为推理的数据类型,
`-p`
为转换时的并行线程数,
`-v`
为启用详细日志记录.
### 运行
LLama
-7b
### 运行
BLOOM
-7b
1.
生成
`gemm_config.in`
文件
1.
生成
`gemm_config.in`
文件
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment