Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Lmdeploy
Commits
bd2e0bf7
Unverified
Commit
bd2e0bf7
authored
Jun 20, 2023
by
lvhan028
Committed by
GitHub
Jun 20, 2023
Browse files
check-in dockerfile (#8)
* check-in dockerfile * check-in dockerfile
parent
9efcac38
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
11 additions
and
1 deletion
+11
-1
README_zh-CN.md
README_zh-CN.md
+1
-1
docker/Dockerfile
docker/Dockerfile
+10
-0
No files found.
README_zh-CN.md
View file @
bd2e0bf7
...
...
@@ -58,7 +58,7 @@ pip install -e .
### 部署 [LLaMA](https://github.com/facebookresearch/llama) 服务
请填写
[
这张表
](
<
(
https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform
?usp=send_form)
>
)
,获取 LLaMA 模型权重。
请填写
[
这张表
](
https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform
)
,获取 LLaMA 模型权重。
执行下面任一命令,可以把 LLaMA 模型部署到 NVIDIA GPU Server:
...
...
docker/Dockerfile
0 → 100644
View file @
bd2e0bf7
FROM
nvcr.io/nvidia/tritonserver:22.12-py3
RUN
apt-get update
&&
apt-get
install
-y
--no-install-recommends
\
rapidjson-dev libgoogle-glog-dev gdb
\
&&
rm
-rf
/var/lib/apt/lists/
*
RUN
python3
-m
pip
install
torch
==
1.13.1+cu117
torchvision
==
0.14.1+cu117
--extra-index-url
https://download.pytorch.org/whl/cu117
RUN
python3
-m
pip
install
sentencepiece cmake
ENV
NCCL_LAUNCH_MODE=GROUP
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment