Commit d42063c1 authored by zhougaofeng's avatar zhougaofeng
Browse files

Update README.md

parent ae408d24
......@@ -45,7 +45,7 @@ pip uninstall vllm
```
docker build -t deepseek-math-df:latest .
docker run -it --shm-size=1024G -v <Host Path>:<Container Path> -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name deepseek-math deepseek-math-df bash
docker run -it --shm-size=1024G -v <Host Path>:<Container Path> -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name deepseek-math deepseek-math-df:latest bash
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
# bitsandbytes可从whl.zip文件里获取安装:
pip install bitsandbytes-0.42.0-py3-none-any.whl
......@@ -74,7 +74,6 @@ triton:2.1.0
```
pip install -r requirements.txt
pip uninstall vllm
```
## 数据集
......@@ -83,8 +82,8 @@ pip uninstall vllm
```
── data
├── alpaca_en_demo.json.json
└── alpaca_zh_demo.json.json
├── alpaca_en_demo.json
└── alpaca_zh_demo.json
```
## 训练
......@@ -107,7 +106,7 @@ sh multi_node.sh
```
cd inference
sh 7B_single_node.sh
python 7B_single_node.py
```
## result
......@@ -116,6 +115,7 @@ sh 7B_single_node.sh
<div align=center>
<img src="./doc/inference.png"/>
<img src="./doc/result.png"/>
</div>
### 精度
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment