Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
00f18159
Commit
00f18159
authored
Nov 21, 2024
by
zhuwenwen
Browse files
update readme
parent
18c811ba
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
README.md
README.md
+4
-4
No files found.
README.md
View file @
00f18159
...
...
@@ -42,9 +42,9 @@ vLLM支持
#### 编译环境准备
提供2种环境准备方式:
1.
基于光源pytorch2.4.
0
基础镜像环境:镜像下载地址:
[
https://sourcefind.cn/#/image/dcu/pytorch
](
https://sourcefind.cn/#/image/dcu/pytorch
)
,根据pytorch2.4.
0
、python、dtk及系统下载对应的镜像版本。
1.
基于光源pytorch2.4.
1
基础镜像环境:镜像下载地址:
[
https://sourcefind.cn/#/image/dcu/pytorch
](
https://sourcefind.cn/#/image/dcu/pytorch
)
,根据pytorch2.4.
1
、python、dtk及系统下载对应的镜像版本。
2.
基于现有python环境:安装pytorch2.4.
0
,pytorch whl包下载目录:
[
https://cancon.hpccube.com:65024/4/main/pytorch
](
https://cancon.hpccube.com:65024/4/main/pytorch
)
,根据python、dtk版本,下载对应pytorch2.4.
0
的whl包。安装命令如下:
2.
基于现有python环境:安装pytorch2.4.
1
,pytorch whl包下载目录:
[
https://cancon.hpccube.com:65024/4/main/pytorch
](
https://cancon.hpccube.com:65024/4/main/pytorch
)
,根据python、dtk版本,下载对应pytorch2.4.
1
的whl包。安装命令如下:
```
shell
pip
install
torch
*
(
下载的torch的whl包
)
pip
install
setuptools wheel
...
...
@@ -71,9 +71,9 @@ VLLM_INSTALL_PUNICA_KERNELS=1 python3 setup.py install
若需要添加git号,设置环境变量: export ADD_GIT_VERSION=1
#### 运行基础环境准备
1、使用上面基于光源pytorch2.4.
0
基础镜像环境
1、使用上面基于光源pytorch2.4.
1
基础镜像环境
2、根据pytorch2.4.
0
、python、dtk及系统下载对应的依赖包:
2、根据pytorch2.4.
1
、python、dtk及系统下载对应的依赖包:
-
triton:
[
https://cancon.hpccube.com:65024/4/main/triton
](
https://cancon.hpccube.com:65024/4/main/triton/
)
-
flash_attn:
[
https://cancon.hpccube.com:65024/4/main/flash_attn
](
https://cancon.hpccube.com:65024/4/main/flash_attn
)
-
lmslim:
[
https://cancon.hpccube.com:65024/4/main/lmslim
](
https://cancon.hpccube.com:65024/4/main/lmslim
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment