Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
DeepSeek-V3_pytorch
Commits
aab042c5
Commit
aab042c5
authored
Feb 03, 2025
by
shantf
Browse files
update readme
parent
a8bff104
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
README.md
README.md
+3
-1
No files found.
README.md
View file @
aab042c5
...
@@ -76,7 +76,9 @@ torchrun --nnodes 4 --nproc-per-node 8 --node-rank $RANK --master-addr $ADDR gen
...
@@ -76,7 +76,9 @@ torchrun --nnodes 4 --nproc-per-node 8 --node-rank $RANK --master-addr $ADDR gen
torchrun
--nnodes
4
--nproc-per-node
8
--node-rank
$RANK
--master-addr
$ADDR
generate.py
--ckpt-path
/path/to/DeepSeek-V3-Demo
--config
configs/config_671B.json
--input-file
$FILE
torchrun
--nnodes
4
--nproc-per-node
8
--node-rank
$RANK
--master-addr
$ADDR
generate.py
--ckpt-path
/path/to/DeepSeek-V3-Demo
--config
configs/config_671B.json
--input-file
$FILE
```
```
注意:需要将/path/to/fp8_weights中的json文件复制到/path/to/DeepSeek-V3-Demo中。
注意:需要将/path/to/fp8_weights中的json文件复制到/path/to/DeepSeek-V3-Demo中。在K100_AI和ECO显卡上需要添加环境变量
export NCCL_ALGO=Ring
export NCCL_PROTO=Simple
## result
## result
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment