Commit d085f69e authored by chenzk's avatar chenzk
Browse files

v1.0.1

parent e75bc9be
......@@ -28,6 +28,8 @@ mv smollm_pytorch smollm # 去框架名后缀
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.3.0-ubuntu22.04-dtk24.04.2-py3.10
# <your IMAGE ID>为以上拉取的docker的镜像ID替换,本镜像为:83714c19d308
docker run -it --shm-size=64G -v $PWD/smollm:/home/smollm -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name smollm2 <your IMAGE ID> bash
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
```
### Dockerfile(方法二)
```
......@@ -37,6 +39,8 @@ docker run --shm-size=64G --name smollm2 -v /opt/hyhal:/opt/hyhal:ro --privilege
# 若遇到Dockerfile启动的方式安装环境需要长时间等待,可注释掉里面的pip安装,启动容器后再安装python库:pip install -r requirements.txt。
cd /home/smollm
pip install -r finetuning/requirements.txt
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
```
### Anaconda(方法三)
1、关于本项目DCU显卡所需的特殊深度学习库可从光合开发者社区下载安装:
......@@ -60,6 +64,8 @@ xformers:0.0.25
```
cd /home/smollm
pip install -r finetuning/requirements.txt
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
```
## 数据集
......
......@@ -5,4 +5,4 @@ accelerate
datasets
scipy
wandb # wandb offline & wandb disabled
bitsandbytes
\ No newline at end of file
# bitsandbytes
\ No newline at end of file
......@@ -5,4 +5,4 @@ accelerate
datasets
scipy
wandb # wandb offline & wandb disabled
bitsandbytes
\ No newline at end of file
# bitsandbytes
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment