Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
llama_inference_pytorch
Commits
1e858614
Commit
1e858614
authored
Aug 14, 2024
by
dcuai
Browse files
Update README.md
parent
e7901994
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
README.md
README.md
+3
-3
No files found.
README.md
View file @
1e858614
...
...
@@ -50,8 +50,8 @@ SwiGLU 激活函数 [PaLM]。使用 SwiGLU 激活函数替换 ReLU 非线性以
推荐使用docker方式运行,提供
[
光源
](
https://www.sourcefind.cn/
)
拉取的docker镜像:
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/
vscode-
pytorch:
1
.1
0
.0-
centos7.6-dtk-22
.1
0
-py3
7-latest
docker run -dit --network=host --name=llama_inference_pytorch --privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1 image.sourcefind.cn:5000/dcu/admin/base/pytorch:
1
.1
0
.0-
centos7.6
-dtk
-23
.04-py3
7-latest
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:
2
.1.0-
ubuntu20.04-dtk24.04
.1-py3
.10
docker run -dit --network=host --name=llama_inference_pytorch --privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1
-v /opt/hyhal:/opt/hyhal:ro
image.sourcefind.cn:5000/dcu/admin/base/pytorch:
2
.1.0-
ubuntu20.04
-dtk
24
.04
.1
-py3
.10
docker exec -it llama_inference_pytorch /bin/bash
```
...
...
@@ -153,6 +153,6 @@ SPM_PATH 为下载的llama 模型tokenizer路径
https://developer.hpccube.com/codes/modelzoo/llama_inference_pytorch
## 参考资料
##
## 参考资料
https://github.com/ProjectD-AI/llama_inference
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment