Commit 4da3c0cf authored by “yuguo”'s avatar “yuguo”
Browse files

update

parent 0f0f4324
...@@ -92,7 +92,7 @@ path/to/bloomz-7b1 ...@@ -92,7 +92,7 @@ path/to/bloomz-7b1
└── pytorch_model.bin └── pytorch_model.bin
``` ```
## BLOOMZ-7B1推理 ## 推理
采用1节点,4张DCU-Z100-16G,采用tp=4,pp=1的并行配置。 采用1节点,4张DCU-Z100-16G,采用tp=4,pp=1的并行配置。
...@@ -151,7 +151,7 @@ demo.py如下: ...@@ -151,7 +151,7 @@ demo.py如下:
if dist.is_main_process(): if dist.is_main_process():
print(res) print(res)
### result ## result
``` ```
>>> >>>
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment