Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
TinyLlama_pytorch
Commits
c4fa2f57
Commit
c4fa2f57
authored
Apr 17, 2025
by
chenzk
Browse files
Update url.md
parent
a2a62069
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
README.md
README.md
+4
-4
No files found.
README.md
View file @
c4fa2f57
...
...
@@ -75,7 +75,7 @@ ln -s /lib64/libstdc++.so.6.0.26 /lib64/libstdc++.so.6
## 数据集
`openassistant-guanaco`
[
huggingface
](
https://huggingface.co/datasets/timdettmers/openassistant-guanaco/tree/main
)
|
[
SCNet
](
http://113.200.138.88:18080/aidatasets/openassistant-guanaco
)
高速通道
[
huggingface
](
https://huggingface.co/datasets/timdettmers/openassistant-guanaco/tree/main
)
项目中已提供用于finetune的迷你数据集,数据目录结构如下:
...
...
@@ -88,11 +88,11 @@ timdettmers/
`SlimPajama-627B`
[
huggingface
](
https://huggingface.co/datasets/cerebras/SlimPajama-627B
)
|
[
SCNet
](
http://113.200.138.88:18080/aidatasets/cerebras/SlimPajama-627B
)
高速通道
[
huggingface
](
https://huggingface.co/datasets/cerebras/SlimPajama-627B
)
`starcoderdata`
[
huggingface
](
https://huggingface.co/datasets/bigcode/starcoderdata
)
|
[
SCNet
](
http://113.200.138.88:18080/aidatasets/bigcode/starcoderdata
)
高速通道
[
huggingface
](
https://huggingface.co/datasets/bigcode/starcoderdata
)
`更多资料可参考源项目的README_origin.md`
## 训练
...
...
@@ -135,7 +135,7 @@ Assistant: Well, I really don't want him to be president because of his position
## 预训练权重
[
huggingface
](
https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-240k-503b
)
|
[
SCNet
](
http://113.200.138.88:18080/aimodels/tinyllama/TinyLlama-1.1B-intermediate-step-240k-503b
)
高速通道
[
huggingface
](
https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-240k-503b
)
## 源码仓库及问题反馈
-
https://developer.hpccube.com/codes/modelzoo/tinyllama_pytorch
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment