Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
starcoder2_pytorch
Commits
3375aa4a
Commit
3375aa4a
authored
Oct 30, 2024
by
dengjb
Browse files
Update README.md
parent
7cd6fcb0
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
15 additions
and
3 deletions
+15
-3
README.md
README.md
+15
-3
No files found.
README.md
View file @
3375aa4a
...
...
@@ -58,7 +58,13 @@ export HF_ENDPOINT=https://hf-mirror.com
```
## 数据集
finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust
[
下载地址
](
https://hf-mirror.com/datasets/bigcode/the-stack-smol
)
<br>
finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust
<br>
-
数据集快速下载中心:
-
[
SCNet AIDatasets
](
http://113.200.138.88:18080/aidatasets
)
-
数据集快速通道下载地址:
-
[
数据集快速下载地址
](
http://113.200.138.88:18080/aidatasets/project-dependency/the-stack-smol/-/tree/main
)
-
官方下载地址
-
[
下载地址
](
https://hf-mirror.com/datasets/bigcode/the-stack-smol
)
<br>
```
angular2html
├── data
│ ├── assembly
...
...
@@ -81,8 +87,14 @@ bash ./train.sh
```
## 推理
基于Huggingface's Transformers进行推理.
<br>
预训练权重快速下载中心:
[
SCNet AIModels
](
http://113.200.138.88:18080/aimodels
)
,项目中的预训练权下载地址
[
starcoder2-7b
](
http://113.200.138.88:18080/aimodels/starcoder2-7b
)
<br>
[
starcoder2-7b官方权重
](
https://huggingface.co/bigcode/starcoder2-7b
)
默认需存放至weights文件夹中
<br>
-
模型权重快速下载中心
-
[
SCNet AIModels
](
http://113.200.138.88:18080/aimodels
)
-
模型权重快速通道下载地址
-
[
模型权重快速下载地址
](
http://113.200.138.88:18080/aimodels/starcoder2-7b
)
-
官方下载地址:
-
[
官方权重下载地址
](
https://huggingface.co/bigcode/starcoder2-7b
)
默认需存放至weights文件夹中
<br>
也可自行更改 inference.py文件中的 model_name 参数
<br>
```
bash
HIP_VISIBLE_DEVICES
=
0 python inference.py
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment