Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
llama3_pytorch
Commits
7ad62ca5
Commit
7ad62ca5
authored
Apr 22, 2024
by
Rayyyyy
Browse files
delete 70B infos
parent
a6a79fa0
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
40 deletions
+4
-40
README.md
README.md
+4
-40
No files found.
README.md
View file @
7ad62ca5
...
...
@@ -40,7 +40,7 @@ pip install -e .
```
bash
DTK驱动:dtk23.10.1
python:python3.8
torch
:
2.1.0
torch
:
2.1.0
```
`Tips:以上dtk驱动、python、torch等DCU相关工具版本需要严格一一对应`
...
...
@@ -70,9 +70,9 @@ pip install -e .
-
`max_seq_len`
和
`max_batch_size`
参数按需设置。
### Pretrained模型
这些模型都没有针对聊天或者Q&A进行微调。可以参考example_text_completion.py里的用例。
这些模型都没有针对聊天或者Q&A进行微调。可以参考
`
example_text_completion.py
`
里的用例。
-
Meta-Llama-3-8B 模型示例
,Meta-Llama-3-70B模型仅需替换--ckpt_dir、--tokenizer_path对应模型地址即可。
-
Meta-Llama-3-8B 模型示例
```
bash
torchrun
--nproc_per_node
1 example_text_completion.py
\
--ckpt_dir
Meta-Llama-3-8B/original/
\
...
...
@@ -89,7 +89,7 @@ torchrun --nproc_per_node 1 example_text_completion.py \
您还可以部署额外的分类器来过滤被认为不安全的输入和输出。有关如何向推理代码的输入和输出添加安全检查器,请参阅
[
llama-recipes repo
](
https://github.com/meta-llama/llama-recipes/blob/main/recipes/inference/local_inference/inference.py
)
。
-
Meta-Llama-3-8B-Instruct 模型示例
,Meta-Llama-3-70B-Instruct模型仅需替换--ckpt_dir、--tokenizer_path对应模型地址即可。
-
Meta-Llama-3-8B-Instruct 模型示例
```
bash
torchrun
--nproc_per_node
1 example_chat_completion.py
\
--ckpt_dir
Meta-Llama-3-8B-Instruct/original/
\
...
...
@@ -140,18 +140,6 @@ mkdir Meta-Llama-3-8B-Instruct
huggingface-cli download meta-llama/Meta-Llama-3-8B-Instruct
--include
"original/*"
--local-dir
Meta-Llama-3-8B-Instruct
--token
hf_
*
```
-
Meta-Llama-3-70B 模型
```
bash
mkdir
Meta-Llama-3-70B
huggingface-cli download meta-llama/Meta-Llama-3-70B
--include
"original/*"
--local-dir
Meta-Llama-3-70B
--token
hf_
*
```
-
Meta-Llama-3-70B-Instruct 模型
```
bash
mkdir
Meta-Llama-3-70B-Instruct
huggingface-cli download meta-llama/Meta-Llama-3-70B-Instruct
--include
"original/*"
--local-dir
Meta-Llama-3-70B-Instruct
--token
hf_
*
```
模型目录结构如下:
```
bash
├── llama3_pytorch
...
...
@@ -165,30 +153,6 @@ huggingface-cli download meta-llama/Meta-Llama-3-70B-Instruct --include "origina
│ ├── consolidated.00.pth
│ ├── params.json
│ └── tokenizer.model
│ ├── Meta-Llama-3-70B
│ ├── original
│ ├── consolidated.00.pth
│ ├── consolidated.01.pth
│ ├── consolidated.02.pth
│ ├── consolidated.03.pth
│ ├── consolidated.04.pth
│ ├── consolidated.05.pth
│ ├── consolidated.06.pth
│ ├── consolidated.07.pth
│ ├── params.json
│ └── tokenizer.model
│ ├── Meta-Llama-3-70B-Instruct
│ ├── original
│ ├── consolidated.00.pth
│ ├── consolidated.01.pth
│ ├── consolidated.02.pth
│ ├── consolidated.03.pth
│ ├── consolidated.04.pth
│ ├── consolidated.05.pth
│ ├── consolidated.06.pth
│ ├── consolidated.07.pth
│ ├── params.json
│ └── tokenizer.model
```
## 源码仓库及问题反馈
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment