Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen_pytorch
Commits
66b69987
Commit
66b69987
authored
Sep 02, 2024
by
dcuai
Browse files
Update README.md
parent
88238ab6
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
20 deletions
+2
-20
README.md
README.md
+2
-20
No files found.
README.md
View file @
66b69987
...
...
@@ -48,6 +48,7 @@ pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --t
```
### conda(方式三)
其中apex、torch、deepspeed需要到
[
开发者社区
](
https://cancon.hpccube.com:65024/4/main/
)
下载对应版本
```
conda create -n qwen python=3.10
...
...
@@ -56,32 +57,13 @@ pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --t
[
torch2.1.0-dtk24.04.1
](
https://cancon.hpccube.com:65024/directlink/4/pytorch/DAS1.1/torch-2.1.0+das1.1.git3ac1bdd.abi1.dtk2404-cp310-cp310-manylinux_2_31_x86_64.whl
)
[
deepspeed0.12.3-dtk24.04.1
](
https://cancon.hpccube.com:65024/directlink/4/deepspeed/DAS1.1/deepspeed-0.12.3+gita724046.abi1.dtk2404.torch2.1.0-cp310-cp310-manylinux_2_31_x86_64.whl
)
Tips:以上dtk驱动、python、deepspeed等工具版本需要严格一一对应。
### 注意
由于dtk版本的deepspeed目前最高是0.9.2因此需要进入虚拟环境修改一些版本判断
```
#到虚拟环境下对应的python/site-packages注释掉一些版本判断
site-packages/accelerate/accelerator.py 文件
287 #if not is_deepspeed_available():
288 # raise ImportError("DeepSpeed is not installed => run `pip install deepspeed` or build it from source.")
289 #if compare_versions("deepspeed", "<", "0.9.3"):
290 # raise ImportError("DeepSpeed version must be >= 0.9.3. Please update DeepSpeed.")
site-packages/transformers/utils/versions.py 文件
43 #if not ops[op](version.parse(got_ver), version.parse(want_ver)):
44 # raise ImportError(
45 # f"{requirement} is required for a normal functioning of this module, but found {pkg}=={got_ver}.{hint}"
46 # )
```
其中apex、torch、deepspeed需要到
[
开发者社区
](
https://cancon.hpccube.com:65024/4/main/
)
下载对应版本
## 数据集
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment