Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
CodeLlama_lmdeploy
Commits
2a1fadfa
Commit
2a1fadfa
authored
Aug 31, 2024
by
shantf
Browse files
update README.md
parent
facfae87
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
4 deletions
+1
-4
README.md
README.md
+1
-4
No files found.
README.md
View file @
2a1fadfa
...
@@ -27,10 +27,9 @@ docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu20.04-dt
...
@@ -27,10 +27,9 @@ docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu20.04-dt
# <Container Path>容器映射路径
# <Container Path>容器映射路径
docker run
-it
--name
codellama
--shm-size
=
1024G
--device
=
/dev/kfd
--device
=
/dev/dri/
--cap-add
=
SYS_PTRACE
--security-opt
seccomp
=
unconfined
--ulimit
memlock
=
-1
:-1
--ipc
=
host
--network
host
--group-add
video
-v
/opt/hyhal:/opt/hyhal:ro
-v
<Host Path>:<Container Path> <Image ID> /bin/bash
docker run
-it
--name
codellama
--shm-size
=
1024G
--device
=
/dev/kfd
--device
=
/dev/dri/
--cap-add
=
SYS_PTRACE
--security-opt
seccomp
=
unconfined
--ulimit
memlock
=
-1
:-1
--ipc
=
host
--network
host
--group-add
video
-v
/opt/hyhal:/opt/hyhal:ro
-v
<Host Path>:<Container Path> <Image ID> /bin/bash
#step 1
cd
lmdeploy
cd
lmdeploy
pip
install
-r
requirements.txt
-i
https://pypi.tuna.tsinghua.edu.cn/simple
pip
install
-r
requirements.txt
-i
https://pypi.tuna.tsinghua.edu.cn/simple
#step 2
source
/opt/dtk/cuda/env.sh
source
/opt/dtk/cuda/env.sh
```
```
...
@@ -163,12 +162,10 @@ lmdeploy serve gradio restful_api_url --server-name ${server_ip} --server-port $
...
@@ -163,12 +162,10 @@ lmdeploy serve gradio restful_api_url --server-name ${server_ip} --server-port $
从https://github.com/bumblebeeMMa/DownLoad_frpc_linux_amd64 下载frpc_linux_amd64文件;
从https://github.com/bumblebeeMMa/DownLoad_frpc_linux_amd64 下载frpc_linux_amd64文件;
本地改名为frpc_linux_amd64_v0.2
本地改名为frpc_linux_amd64_v0.2
上传到gradio安装路径下面,gradio安装包路径可以使用如下方法找到,在终端输入下面语句:
上传到gradio安装路径下面,gradio安装包路径可以使用如下方法找到,在终端输入下面语句:
```
bash
python
python
import gradio
import gradio
gradio
gradio
```
```
```
关于 RESTful API的详细介绍,请参考
[
这份
](
https://developer.hpccube.com/codes/aicomponent/lmdeploy/-/blob/dtk23.04-v0.0.13/docs/zh_cn/restful_api.md
)
文档。
关于 RESTful API的详细介绍,请参考
[
这份
](
https://developer.hpccube.com/codes/aicomponent/lmdeploy/-/blob/dtk23.04-v0.0.13/docs/zh_cn/restful_api.md
)
文档。
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment