Commit d1221104 authored by dengjb's avatar dengjb
Browse files

fixed readme

parent 1a9e39eb
...@@ -34,7 +34,7 @@ export HF_ENDPOINT=https://hf-mirror.com ...@@ -34,7 +34,7 @@ export HF_ENDPOINT=https://hf-mirror.com
```bash ```bash
cd docker cd docker
docker build --no-cache -t deepseek_coder:latest . docker build --no-cache -t starcoder2:latest .
docker run -it -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal/:/opt/hyhal/:ro --shm-size=80G --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name docker_name imageID bash docker run -it -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal/:/opt/hyhal/:ro --shm-size=80G --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name docker_name imageID bash
cd /your_code_path/starcoder2_pytorch cd /your_code_path/starcoder2_pytorch
...@@ -60,8 +60,8 @@ export HF_ENDPOINT=https://hf-mirror.com ...@@ -60,8 +60,8 @@ export HF_ENDPOINT=https://hf-mirror.com
## 数据集 ## 数据集
finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust [下载地址](https://hf-mirror.com/datasets/bigcode/the-stack-smol)<br> finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust [下载地址](https://hf-mirror.com/datasets/bigcode/the-stack-smol)<br>
```angular2html ```angular2html
├── data │4 37.0C 59.0W auto 300.0W 0% 0% Normal ├── data
│ ├── assembly │5 37.0C 62.0W auto 300.0W 0% 0% Normal │ ├── assembly
│ │ └── data.json │ │ └── data.json
│ ├── rust │ ├── rust
│ │ └── data.json │ │ └── data.json
...@@ -72,7 +72,7 @@ finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust [ ...@@ -72,7 +72,7 @@ finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust [
</div> </div>
## 训练 ## 训练
### 单机 ### 单机
具体参数更改请在train.sh文件中进行,以下为必要参数 <br> 具体参数更改请在train.sh文件中进行,以下为必要参数 <br>
dataset_name="{数据集地址}" <br> dataset_name="{数据集地址}" <br>
model_name="{预训练模型加载地址}" <br> model_name="{预训练模型加载地址}" <br>
...@@ -81,7 +81,7 @@ bash ./train.sh ...@@ -81,7 +81,7 @@ bash ./train.sh
``` ```
## 推理 ## 推理
基于Huggingface's Transformers进行推理.<br> 基于Huggingface's Transformers进行推理.<br>
模型下载后 默认需存放至weights文件夹中<br> 模型下载后[模型下载地址](https://huggingface.co/bigcode/starcoder2-7b) 默认需存放至weights文件夹中<br>
也可自行更改 inference.py文件中的 model_name 参数<br> 也可自行更改 inference.py文件中的 model_name 参数<br>
```bash ```bash
HIP_VISIBLE_DEVICES=0 python inference.py HIP_VISIBLE_DEVICES=0 python inference.py
......
asserts/result.png

24.4 KB | W: | H:

asserts/result.png

109 KB | W: | H:

asserts/result.png
asserts/result.png
asserts/result.png
asserts/result.png
  • 2-up
  • Swipe
  • Onion skin
FROM image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment