Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
starcoder2_pytorch
Commits
d1221104
Commit
d1221104
authored
Jun 17, 2024
by
dengjb
Browse files
fixed readme
parent
1a9e39eb
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
6 additions
and
5 deletions
+6
-5
README.md
README.md
+5
-5
asserts/result.png
asserts/result.png
+0
-0
docker/Dockerfile
docker/Dockerfile
+1
-0
No files found.
README.md
View file @
d1221104
...
...
@@ -34,7 +34,7 @@ export HF_ENDPOINT=https://hf-mirror.com
```
bash
cd
docker
docker build
--no-cache
-t
deepseek_
coder:latest
.
docker build
--no-cache
-t
star
coder
2
:latest
.
docker run
-it
-v
/path/your_code_data/:/path/your_code_data/
-v
/opt/hyhal/:/opt/hyhal/:ro
--shm-size
=
80G
--privileged
=
true
--device
=
/dev/kfd
--device
=
/dev/dri/
--group-add
video
--name
docker_name imageID bash
cd
/your_code_path/starcoder2_pytorch
...
...
@@ -60,8 +60,8 @@ export HF_ENDPOINT=https://hf-mirror.com
## 数据集
finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust
[
下载地址
](
https://hf-mirror.com/datasets/bigcode/the-stack-smol
)
<br>
```
angular2html
├── data
│4 37.0C 59.0W auto 300.0W 0% 0% Normal
│ ├── assembly
│5 37.0C 62.0W auto 300.0W 0% 0% Normal
├── data
│ ├── assembly
│ │ └── data.json
│ ├── rust
│ │ └── data.json
...
...
@@ -72,7 +72,7 @@ finetune训练样例数据采用bigcode/the-stack-smol 下的子集/data/rust [
</div>
## 训练
### 单机
四
卡
### 单机
两
卡
具体参数更改请在train.sh文件中进行,以下为必要参数
<br>
dataset_name="{数据集地址}"
<br>
model_name="{预训练模型加载地址}"
<br>
...
...
@@ -81,7 +81,7 @@ bash ./train.sh
```
## 推理
基于Huggingface's Transformers进行推理.
<br>
模型下载后 默认需存放至weights文件夹中
<br>
模型下载后
[
模型下载地址
](
https://huggingface.co/bigcode/starcoder2-7b
)
默认需存放至weights文件夹中
<br>
也可自行更改 inference.py文件中的 model_name 参数
<br>
```
bash
HIP_VISIBLE_DEVICES
=
0 python inference.py
...
...
asserts/result.png
View replaced file @
1a9e39eb
View file @
d1221104
24.4 KB
|
W:
|
H:
109 KB
|
W:
|
H:
2-up
Swipe
Onion skin
docker/Dockerfile
0 → 100644
View file @
d1221104
FROM
image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk24.04-py310
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment