Skip to content

GitLab

Commit 0ab59755 authored by shantf's avatar shantf
Browse files

update README.md and finetune_demo/configs/sft.yaml

parent 5c082071
Show whitespace changes
Inline Side-by-side
Showing with 6 additions and 6 deletions
README.md
View file @ 0ab59755
...@@ -34,12 +34,12 @@ ChatGLM3-6B同样采用Transformer模型结构： ...@@ -34,12 +34,12 @@ ChatGLM3-6B同样采用Transformer模型结构：
### Docker(方式一) ### Docker(方式一)
推荐使用docker方式运行，提供拉取的docker镜像： 推荐使用docker方式运行，提供拉取的docker镜像：
```bash ```bash
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk23.10.1-py310 docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu20.04-dtk24.04.1-py3.10
``` ```
进入docker，安装docker中没有的依赖: 进入docker，安装docker中没有的依赖:
```bash ```bash
docker run -dit --network=host --name=chatglm3 --privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G -v /opt/hyhal/:/opt/hyhal/:ro --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1 image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk23.10.1-py310 docker run -dit --network=host --name=chatglm3 --privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G -v /opt/hyhal/:/opt/hyhal/:ro --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1 image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu20.04-dtk24.04.1-py3.10
docker exec -it chatglm3 /bin/bash docker exec -it chatglm3 /bin/bash
pip install -r requirements.txt -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com pip install -r requirements.txt -i http://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
cd finetune_demo cd finetune_demo
...@@ -54,9 +54,9 @@ conda create -n chatglm python=3.10 ...@@ -54,9 +54,9 @@ conda create -n chatglm python=3.10
2. 关于本项目DCU显卡所需的工具包、深度学习库等均可从[光合](https://developer.hpccube.com/tool/)开发者社区下载安装。 2. 关于本项目DCU显卡所需的工具包、深度学习库等均可从[光合](https://developer.hpccube.com/tool/)开发者社区下载安装。
- [DTK 23.10.1](https://cancon.hpccube.com:65024/1/main/DTK-23.10.1) - [DTK 24.04.1](https://cancon.hpccube.com:65024/1/main/DTK-24.04.1)
- [Pytorch 2.1](https://cancon.hpccube.com:65024/4/main/pytorch/previous_release/dtk23.10) - [Pytorch 2.1.0](https://cancon.hpccube.com:65024/4/main/pytorch)
- [Deepspeed 0.12.3](https://cancon.hpccube.com:65024/4/main/deepspeed/previous_release/dtk23.10) - [Deepspeed 0.12.3](https://cancon.hpccube.com:65024/directlink/4/deepspeed/DAS1.1/deepspeed-0.12.3+gita724046.abi1.dtk2404.torch2.1.0-cp310-cp310-manylinux_2_31_x86_64.whl)
Tips：以上dtk驱动、python、deepspeed等工具版本需要严格一一对应。 Tips：以上dtk驱动、python、deepspeed等工具版本需要严格一一对应。
......
finetune_demo/configs/sft.yaml
View file @ 0ab59755
...@@ -34,4 +34,4 @@ training_args: ...@@ -34,4 +34,4 @@ training_args:
generation_config: generation_config:
max_new_tokens: 512 max_new_tokens: 512
# set your absolute deepspeed path here # set your absolute deepspeed path here
deepspeed: ds_zero_3.json deepspeed: ./configs/ds_zero_3.json
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment