Commit 3375aa4a authored by dengjb's avatar dengjb
Browse files

Update README.md

parent 7cd6fcb0
......@@ -58,7 +58,13 @@ export HF_ENDPOINT=https://hf-mirror.com
```
## 数据集
finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust [下载地址](https://hf-mirror.com/datasets/bigcode/the-stack-smol)<br>
finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust <br>
- 数据集快速下载中心:
- [SCNet AIDatasets](http://113.200.138.88:18080/aidatasets)
- 数据集快速通道下载地址:
- [数据集快速下载地址](http://113.200.138.88:18080/aidatasets/project-dependency/the-stack-smol/-/tree/main)
- 官方下载地址
- [下载地址](https://hf-mirror.com/datasets/bigcode/the-stack-smol)<br>
```angular2html
├── data
│ ├── assembly
......@@ -81,8 +87,14 @@ bash ./train.sh
```
## 推理
基于Huggingface's Transformers进行推理.<br>
预训练权重快速下载中心:[SCNet AIModels](http://113.200.138.88:18080/aimodels) ,项目中的预训练权下载地址[starcoder2-7b](http://113.200.138.88:18080/aimodels/starcoder2-7b)<br>
[starcoder2-7b官方权重](https://huggingface.co/bigcode/starcoder2-7b) 默认需存放至weights文件夹中<br>
- 模型权重快速下载中心
- [SCNet AIModels](http://113.200.138.88:18080/aimodels)
- 模型权重快速通道下载地址
- [模型权重快速下载地址](http://113.200.138.88:18080/aimodels/starcoder2-7b)
- 官方下载地址:
- [官方权重下载地址](https://huggingface.co/bigcode/starcoder2-7b)
默认需存放至weights文件夹中<br>
也可自行更改 inference.py文件中的 model_name 参数<br>
```bash
HIP_VISIBLE_DEVICES=0 python inference.py
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment