Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
llama_tgi
Commits
163fb0ff
Commit
163fb0ff
authored
Nov 04, 2024
by
xuxzh1
🎱
Browse files
update
parent
0875033d
Changes
4
Show whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
15 additions
and
12 deletions
+15
-12
README.md
README.md
+9
-12
icon.png
icon.png
+0
-0
model.properties
model.properties
+6
-0
readme_images/img1.png
readme_images/img1.png
+0
-0
No files found.
README.md
View file @
163fb0ff
...
@@ -93,12 +93,12 @@ export PYTORCH_TUNABLEOP_ENABLED=0
...
@@ -93,12 +93,12 @@ export PYTORCH_TUNABLEOP_ENABLED=0
### 模型下载
### 模型下载
| 基座模型 | chat模型 | GPTQ模型 |
| 基座模型 | chat模型 | GPTQ模型 |
| ------------------------------------------------------------
------------------- | --------------------------
------------------------------------------------------------
------- | -------------------------------------
------------------------------------------------------------ |
| ------------------------------------------------------------
|
------------------------------------------------------------
|
------------------------------------------------------------ |
|
[
Llama-2-7b-hf
](
http
s
://
huggingface.co/meta-llama
/Llama-2-7b-hf
)
|
[
Llama-2-7b-chat-hf
](
https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
)
|
[
Llama-2-7B-Chat-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-7B-Chat-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-7b-hf
](
http://
113.200.138.88:18080/aimodels/Llama-2-7b-hf/-/archive/main
/Llama-2-7b-hf
-main.tar.gz
)
|
[
Llama-2-7b-chat-hf
](
https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
)
|
[
Llama-2-7B-Chat-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-7B-Chat-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-13b-hf
](
http
s
://
huggingface.co/meta-llama
/Llama-2-13b-hf
)
|
[
Llama-2-13b-chat-hf
](
https://huggingface.co/meta-llama/Llama-2-13b-chat-hf
)
|
[
Llama-2-13B-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-13B-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-13b-hf
](
http://
113.200.138.88:18080/aimodels/Llama-2-13b-hf/-/archive/main
/Llama-2-13b-hf
-main.tar.gz
)
|
[
Llama-2-13b-chat-hf
](
https://huggingface.co/meta-llama/Llama-2-13b-chat-hf
)
|
[
Llama-2-13B-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-13B-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-70b-hf
](
http
s
://
huggingface.co/meta-llama/Llama-2-70b-hf
)
|
[
Llama-2-70b-chat-hf
](
https://huggingface.co/meta-llama/Llama-2-70b-chat-hf
)
|
[
Llama-2-70B-Chat-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-70B-Chat-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-70b-hf
](
http://
113.200.138.88:18080/aimodels/meta-llama/Llama-2-70b-hf/-/archive/main/Llama-2-70b-hf-main.tar.gz
)
|
[
Llama-2-70b-chat-hf
](
https://huggingface.co/meta-llama/Llama-2-70b-chat-hf
)
|
[
Llama-2-70B-Chat-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-70B-Chat-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Meta-Llama-3-8B
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B
)
|
[
Meta-Llama-3-8B-Instruct
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
)
|
|
[
Meta-Llama-3-8B
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B
)
|
[
Meta-Llama-3-8B-Instruct
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
)
|
|
|
[
Meta-Llama-3-70B
](
http
s
://
huggingface.co
/meta-llama/Meta-Llama-3-70B
)
|
[
Meta-Llama-3-70B-Instruct
](
https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct
)
|
|
[
Meta-Llama-3-70B
](
http://
113.200.138.88:18080/aimodels
/meta-llama/Meta-Llama-3
.1
-70B
/-/archive/main/Meta-Llama-3.1-70B-main.tar.gz
)
|
[
Meta-Llama-3-70B-Instruct
](
https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct
)
|
|
### 部署TGI
### 部署TGI
...
@@ -150,12 +150,9 @@ text-generation-benchmark -s 32 -d 128 --runs 10 --tokenizer-name /path/to/Llama
...
@@ -150,12 +150,9 @@ text-generation-benchmark -s 32 -d 128 --runs 10 --tokenizer-name /path/to/Llama
text-generation-benchmark --help
text-generation-benchmark --help
```
```
### 推理结果
## 应用场景
### 精度
无
## 应用场景
### 算法类别
### 算法类别
对话问答
对话问答
...
...
icon.png
0 → 100644
View file @
163fb0ff
53.8 KB
model.properties
0 → 100644
View file @
163fb0ff
# 模型名称
modelName
=
llama_tgi
# 模型描述
modelDescription
=
自然语言理解、生成、翻译等多个场景
# 框架类型
frameType
=
推理框架tgi
readme_images/img1.png
0 → 100644
View file @
163fb0ff
202 KB
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment