Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
guobj
gemma2_vllm
Commits
b8bab908
Commit
b8bab908
authored
Dec 19, 2024
by
guobj
Browse files
Update README.md
parent
c9671d72
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
6 deletions
+7
-6
README.md
README.md
+7
-6
No files found.
README.md
View file @
b8bab908
...
@@ -71,14 +71,15 @@ conda create -n gemma2_vllm python=3.10
...
@@ -71,14 +71,15 @@ conda create -n gemma2_vllm python=3.10
**快速下载通道:**
**快速下载通道:**
| 基座模型 | SCnet快速下载链接 |
| 基座模型 | SCnet快速下载链接 |
| ------- | ------- |
| ------- | ------- |
|
[
gemma-2-2b
]
| (http://113.200.138.88:18080/aimodels/gemma-2-2b)|
| gemma-2-2b| (http://113.200.138.88:18080/aimodels/gemma-2-2b)|
|
[
gemma-2-2b-it
]
| (http://113.200.138.88:18080/aimodels/gemma-2-2b-it)|
| gemma-2-2b-it| (http://113.200.138.88:18080/aimodels/gemma-2-2b-it)|
|
[
gemma-2-9b
]
| (http://113.200.138.88:18080/aimodels/gemma-2-9b)|
| gemma-2-9b| (http://113.200.138.88:18080/aimodels/gemma-2-9b)|
|
[
gemma-2-9b-it
]
| (http://113.200.138.88:18080/aimodels/gemma-2-9b-it)|
| gemma-2-9b-it| (http://113.200.138.88:18080/aimodels/gemma-2-9b-it)|
|
[
gemma-2-27b
]
| (http://113.200.138.88:18080/aimodels/google/gemma-2-27b)|
| gemma-2-27b| (http://113.200.138.88:18080/aimodels/google/gemma-2-27b)|
|
[
gemma-2-27b-it
]
| (http://113.200.138.88:18080/aimodels/gemma-2-27b-it)|
| gemma-2-27b-it| (http://113.200.138.88:18080/aimodels/gemma-2-27b-it)|
| 注 | 需要修改相应模型的config.json中"attn_logit_softcapping": null ;"final_logit_softcapping": null |
| 注 | 需要修改相应模型的config.json中"attn_logit_softcapping": null ;"final_logit_softcapping": null |
| ------- | ------- |
### 离线批量推理
### 离线批量推理
```
bash
```
bash
python examples/offline_inference.py
python examples/offline_inference.py
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment