Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
LLama_fastertransformer
Commits
0a52ac24
Commit
0a52ac24
authored
Sep 06, 2023
by
zhuwenwen
Browse files
add parse out
parent
d8f03ffe
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
0 deletions
+6
-0
README.md
README.md
+6
-0
No files found.
README.md
View file @
0a52ac24
...
@@ -132,6 +132,12 @@ vocab_size=vocab_size
...
@@ -132,6 +132,12 @@ vocab_size=vocab_size
build/
build/
out
out
```
```
执行一下命令可以解析out结果:
```
bash
pip
install
sentencepiece
python ../examples/cpp/llama/llama_tokenizer.py
其中,
`
tokenizer
`
为原模型路径
```
## 精度
## 精度
测试数据:"I believe the meaning of life is" (token id: 306, 4658, 278, 6593, 310, 2834, 338),使用的加速卡:1张 DCU-Z100L-32G
测试数据:"I believe the meaning of life is" (token id: 306, 4658, 278, 6593, 310, 2834, 338),使用的加速卡:1张 DCU-Z100L-32G
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment