Commit d085f69e authored by chenzk's avatar chenzk
Browse files

v1.0.1

parent e75bc9be
...@@ -28,6 +28,8 @@ mv smollm_pytorch smollm # 去框架名后缀 ...@@ -28,6 +28,8 @@ mv smollm_pytorch smollm # 去框架名后缀
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.3.0-ubuntu22.04-dtk24.04.2-py3.10 docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.3.0-ubuntu22.04-dtk24.04.2-py3.10
# <your IMAGE ID>为以上拉取的docker的镜像ID替换,本镜像为:83714c19d308 # <your IMAGE ID>为以上拉取的docker的镜像ID替换,本镜像为:83714c19d308
docker run -it --shm-size=64G -v $PWD/smollm:/home/smollm -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name smollm2 <your IMAGE ID> bash docker run -it --shm-size=64G -v $PWD/smollm:/home/smollm -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name smollm2 <your IMAGE ID> bash
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
``` ```
### Dockerfile(方法二) ### Dockerfile(方法二)
``` ```
...@@ -37,6 +39,8 @@ docker run --shm-size=64G --name smollm2 -v /opt/hyhal:/opt/hyhal:ro --privilege ...@@ -37,6 +39,8 @@ docker run --shm-size=64G --name smollm2 -v /opt/hyhal:/opt/hyhal:ro --privilege
# 若遇到Dockerfile启动的方式安装环境需要长时间等待,可注释掉里面的pip安装,启动容器后再安装python库:pip install -r requirements.txt。 # 若遇到Dockerfile启动的方式安装环境需要长时间等待,可注释掉里面的pip安装,启动容器后再安装python库:pip install -r requirements.txt。
cd /home/smollm cd /home/smollm
pip install -r finetuning/requirements.txt pip install -r finetuning/requirements.txt
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
``` ```
### Anaconda(方法三) ### Anaconda(方法三)
1、关于本项目DCU显卡所需的特殊深度学习库可从光合开发者社区下载安装: 1、关于本项目DCU显卡所需的特殊深度学习库可从光合开发者社区下载安装:
...@@ -60,6 +64,8 @@ xformers:0.0.25 ...@@ -60,6 +64,8 @@ xformers:0.0.25
``` ```
cd /home/smollm cd /home/smollm
pip install -r finetuning/requirements.txt pip install -r finetuning/requirements.txt
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
``` ```
## 数据集 ## 数据集
......
...@@ -5,4 +5,4 @@ accelerate ...@@ -5,4 +5,4 @@ accelerate
datasets datasets
scipy scipy
wandb # wandb offline & wandb disabled wandb # wandb offline & wandb disabled
bitsandbytes # bitsandbytes
\ No newline at end of file \ No newline at end of file
...@@ -5,4 +5,4 @@ accelerate ...@@ -5,4 +5,4 @@ accelerate
datasets datasets
scipy scipy
wandb # wandb offline & wandb disabled wandb # wandb offline & wandb disabled
bitsandbytes # bitsandbytes
\ No newline at end of file \ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment