Commit 66b69987 authored by dcuai's avatar dcuai
Browse files

Update README.md

parent 88238ab6
...@@ -48,6 +48,7 @@ pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --t ...@@ -48,6 +48,7 @@ pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --t
``` ```
### conda(方式三) ### conda(方式三)
其中apex、torch、deepspeed需要到[开发者社区](https://cancon.hpccube.com:65024/4/main/)下载对应版本
``` ```
conda create -n qwen python=3.10 conda create -n qwen python=3.10
...@@ -56,32 +57,13 @@ pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --t ...@@ -56,32 +57,13 @@ pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --t
[torch2.1.0-dtk24.04.1](https://cancon.hpccube.com:65024/directlink/4/pytorch/DAS1.1/torch-2.1.0+das1.1.git3ac1bdd.abi1.dtk2404-cp310-cp310-manylinux_2_31_x86_64.whl) [torch2.1.0-dtk24.04.1](https://cancon.hpccube.com:65024/directlink/4/pytorch/DAS1.1/torch-2.1.0+das1.1.git3ac1bdd.abi1.dtk2404-cp310-cp310-manylinux_2_31_x86_64.whl)
[deepspeed0.12.3-dtk24.04.1](https://cancon.hpccube.com:65024/directlink/4/deepspeed/DAS1.1/deepspeed-0.12.3+gita724046.abi1.dtk2404.torch2.1.0-cp310-cp310-manylinux_2_31_x86_64.whl) [deepspeed0.12.3-dtk24.04.1](https://cancon.hpccube.com:65024/directlink/4/deepspeed/DAS1.1/deepspeed-0.12.3+gita724046.abi1.dtk2404.torch2.1.0-cp310-cp310-manylinux_2_31_x86_64.whl)
Tips:以上dtk驱动、python、deepspeed等工具版本需要严格一一对应。 Tips:以上dtk驱动、python、deepspeed等工具版本需要严格一一对应。
### 注意
由于dtk版本的deepspeed目前最高是0.9.2因此需要进入虚拟环境修改一些版本判断
```
#到虚拟环境下对应的python/site-packages注释掉一些版本判断
site-packages/accelerate/accelerator.py 文件
287 #if not is_deepspeed_available():
288 # raise ImportError("DeepSpeed is not installed => run `pip install deepspeed` or build it from source.")
289 #if compare_versions("deepspeed", "<", "0.9.3"):
290 # raise ImportError("DeepSpeed version must be >= 0.9.3. Please update DeepSpeed.")
site-packages/transformers/utils/versions.py 文件
43 #if not ops[op](version.parse(got_ver), version.parse(want_ver)):
44 # raise ImportError(
45 # f"{requirement} is required for a normal functioning of this module, but found {pkg}=={got_ver}.{hint}"
46 # )
```
其中apex、torch、deepspeed需要到[开发者社区](https://cancon.hpccube.com:65024/4/main/)下载对应版本
## 数据集 ## 数据集
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment