Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
smollm_pytorch
Commits
d085f69e
Commit
d085f69e
authored
Nov 28, 2024
by
chenzk
Browse files
v1.0.1
parent
e75bc9be
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
8 additions
and
2 deletions
+8
-2
README.md
README.md
+6
-0
docker/requirements.txt
docker/requirements.txt
+1
-1
finetuning/requirements.txt
finetuning/requirements.txt
+1
-1
whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
+0
-0
No files found.
README.md
View file @
d085f69e
...
@@ -28,6 +28,8 @@ mv smollm_pytorch smollm # 去框架名后缀
...
@@ -28,6 +28,8 @@ mv smollm_pytorch smollm # 去框架名后缀
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.3.0-ubuntu22.04-dtk24.04.2-py3.10
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.3.0-ubuntu22.04-dtk24.04.2-py3.10
# <your IMAGE ID>为以上拉取的docker的镜像ID替换,本镜像为:83714c19d308
# <your IMAGE ID>为以上拉取的docker的镜像ID替换,本镜像为:83714c19d308
docker run -it --shm-size=64G -v $PWD/smollm:/home/smollm -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name smollm2 <your IMAGE ID> bash
docker run -it --shm-size=64G -v $PWD/smollm:/home/smollm -v /opt/hyhal:/opt/hyhal:ro --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name smollm2 <your IMAGE ID> bash
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
```
```
### Dockerfile(方法二)
### Dockerfile(方法二)
```
```
...
@@ -37,6 +39,8 @@ docker run --shm-size=64G --name smollm2 -v /opt/hyhal:/opt/hyhal:ro --privilege
...
@@ -37,6 +39,8 @@ docker run --shm-size=64G --name smollm2 -v /opt/hyhal:/opt/hyhal:ro --privilege
# 若遇到Dockerfile启动的方式安装环境需要长时间等待,可注释掉里面的pip安装,启动容器后再安装python库:pip install -r requirements.txt。
# 若遇到Dockerfile启动的方式安装环境需要长时间等待,可注释掉里面的pip安装,启动容器后再安装python库:pip install -r requirements.txt。
cd /home/smollm
cd /home/smollm
pip install -r finetuning/requirements.txt
pip install -r finetuning/requirements.txt
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
```
```
### Anaconda(方法三)
### Anaconda(方法三)
1、关于本项目DCU显卡所需的特殊深度学习库可从光合开发者社区下载安装:
1、关于本项目DCU显卡所需的特殊深度学习库可从光合开发者社区下载安装:
...
@@ -60,6 +64,8 @@ xformers:0.0.25
...
@@ -60,6 +64,8 @@ xformers:0.0.25
```
```
cd /home/smollm
cd /home/smollm
pip install -r finetuning/requirements.txt
pip install -r finetuning/requirements.txt
# 安装bnb库
pip install whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
```
```
## 数据集
## 数据集
...
...
docker/requirements.txt
View file @
d085f69e
...
@@ -5,4 +5,4 @@ accelerate
...
@@ -5,4 +5,4 @@ accelerate
datasets
datasets
scipy
scipy
wandb # wandb offline & wandb disabled
wandb # wandb offline & wandb disabled
bitsandbytes
# bitsandbytes
\ No newline at end of file
\ No newline at end of file
finetuning/requirements.txt
View file @
d085f69e
...
@@ -5,4 +5,4 @@ accelerate
...
@@ -5,4 +5,4 @@ accelerate
datasets
datasets
scipy
scipy
wandb # wandb offline & wandb disabled
wandb # wandb offline & wandb disabled
bitsandbytes
# bitsandbytes
\ No newline at end of file
\ No newline at end of file
whl/bitsandbytes-0.42.0+das.opt1.dtk24042-py3-none-any.whl
0 → 100644
View file @
d085f69e
File added
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment