Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
675c0abe
Commit
675c0abe
authored
May 23, 2024
by
zhuwenwen
Browse files
update version
parent
66acc938
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
6 additions
and
6 deletions
+6
-6
README.md
README.md
+5
-5
setup.py
setup.py
+1
-1
No files found.
README.md
View file @
675c0abe
...
...
@@ -39,7 +39,7 @@ vLLM支持
1.
基于光源pytorch2.1.0基础镜像环境:镜像下载地址:
[
https://sourcefind.cn/#/image/dcu/pytorch
](
https://sourcefind.cn/#/image/dcu/pytorch
)
,根据pytorch2.1.0、python、dtk及系统下载对应的镜像版本。
2.
基于现有python环境:安装pytorch2.1.0,pytorch whl包下载目录:
[
https://cancon.hpccube.com:65024/4/main/pytorch
/DAS1.0
](
https://cancon.hpccube.com:65024/4/main/pytorch
/DAS1.0
)
,根据python、dtk版本,下载对应pytorch2.1.0的whl包。安装命令如下:
2.
基于现有python环境:安装pytorch2.1.0,pytorch whl包下载目录:
[
https://cancon.hpccube.com:65024/4/main/pytorch
](
https://cancon.hpccube.com:65024/4/main/pytorch
)
,根据python、dtk版本,下载对应pytorch2.1.0的whl包。安装命令如下:
```
shell
pip
install
torch
*
(
下载的torch的whl包
)
pip
install
setuptools wheel
...
...
@@ -64,10 +64,10 @@ python3 setup.py install
#### 运行基础环境准备
1、使用基于光源pytorch2.1.0基础镜像环境:docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310
2、安装对应
依赖
的包:
-
triton:
[
https://cancon.hpccube.com:65024/4/main/triton
/DAS1.0
](
https://cancon.hpccube.com:65024/4/main/triton
/DAS1.0
)
-
xformers:
[
https://cancon.hpccube.com:65024/4/main/xformers
/DAS1.0
](
https://cancon.hpccube.com:65024/4/main/xformers
/DAS1.0
)
-
flash_attn:
[
https://cancon.hpccube.com:65024/4/main/flash_attn
/DAS1.0
](
https://cancon.hpccube.com:65024/4/main/flash_attn/
DAS1.0
)
2、安装
以下依赖
对应的包:
-
triton:
[
https://cancon.hpccube.com:65024/4/main/triton
](
https://cancon.hpccube.com:65024/4/main/triton
)
-
xformers:
[
https://cancon.hpccube.com:65024/4/main/xformers
](
https://cancon.hpccube.com:65024/4/main/xformers
)
-
flash_attn:
[
https://cancon.hpccube.com:65024/4/main/flash_attn
](
https://cancon.hpccube.com:65024/4/main/flash_attn/
)
#### 注意事项
...
...
setup.py
View file @
675c0abe
...
...
@@ -414,7 +414,7 @@ def get_version_add(sha: Optional[str] = None) -> str:
if
sha
!=
'Unknown'
:
if
sha
is
None
:
sha
=
get_sha
(
vllm_root
)
version
=
'das1.1
+
'
+
sha
[:
7
]
version
=
'das1.1
.git
'
+
sha
[:
7
]
# abi version
version
+=
"."
+
get_abi
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment