Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
LLaMA_vllm
Commits
2a7ebc1a
Commit
2a7ebc1a
authored
Aug 30, 2024
by
zhuwenwen
Browse files
update readme
parent
c3145190
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
3 deletions
+3
-3
README.md
README.md
+3
-3
icon.png
icon.png
+0
-0
No files found.
README.md
View file @
2a7ebc1a
...
...
@@ -53,7 +53,7 @@ conda create -n llama_vllm python=3.10
pip install aiohttp==3.9.1 outlines==0.0.37 openai==1.23.3
```
关于本项目DCU显卡所需的特殊深度学习库可从
[
光合
](
https://developer.hpccube.com/tool/
)
开发者社区下载安装。
*
DTK驱动:dtk24.04
*
DTK驱动:dtk24.04
.1
*
Pytorch: 2.1.0
*
triton:2.1.0
*
vllm: 0.3.3
...
...
@@ -84,8 +84,8 @@ cd dist && pip install vllm*
| 基座模型 | chat模型 | GPTQ模型 |
| ------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------- |
|
[
Llama-2-7b-hf
](
https://huggingface.co/meta-llama/Llama-2-7b-hf
)
|
[
Llama-2-7b-chat-hf
](
https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
)
|
[
Llama-2-7B-Chat-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-7B-Chat-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-13b-hf
](
https://huggingface.co/meta-llama/Llama-2-13b-hf
)
|
[
Llama-2-13b-chat-hf
](
http
s
://
huggingface.co
/meta-llama/Llama-2-13b-chat-hf
)
|
[
Llama-2-13B-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-13B-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-70b-hf
](
http
s
://
huggingface.co
/meta-llama/Llama-2-70b-hf
)
|
[
Llama-2-70b-chat-hf
](
http
s
://
huggingface.co
/meta-llama/Llama-2-70b-chat-hf
)
|
[
Llama-2-70B-Chat-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-70B-Chat-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-13b-hf
](
https://huggingface.co/meta-llama/Llama-2-13b-hf
)
|
[
Llama-2-13b-chat-hf
](
http://
113.200.138.88:18080/aimodels
/meta-llama/Llama-2-13b-chat-hf
)
|
[
Llama-2-13B-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-13B-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Llama-2-70b-hf
](
http://
113.200.138.88:18080/aimodels
/meta-llama/Llama-2-70b-hf
)
|
[
Llama-2-70b-chat-hf
](
http://
113.200.138.88:18080/aimodels
/meta-llama/Llama-2-70b-chat-hf
)
|
[
Llama-2-70B-Chat-GPTQ
](
https://huggingface.co/TheBloke/Llama-2-70B-Chat-GPTQ/tree/gptq-4bit-128g-actorder_True
)
|
|
[
Meta-Llama-3-8B
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B
)
|
[
Meta-Llama-3-8B-Instruct
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
)
|
|
[
Meta-Llama-3-70B
](
https://huggingface.co/meta-llama/Meta-Llama-3-70B
)
|
[
Meta-Llama-3-70B-Instruct
](
https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct
)
|
...
...
icon.png
0 → 100644
View file @
2a7ebc1a
53.8 KB
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment