Commit b8bab908 authored by guobj's avatar guobj
Browse files

Update README.md

parent c9671d72
...@@ -71,14 +71,15 @@ conda create -n gemma2_vllm python=3.10 ...@@ -71,14 +71,15 @@ conda create -n gemma2_vllm python=3.10
**快速下载通道:** **快速下载通道:**
| 基座模型 | SCnet快速下载链接 | | 基座模型 | SCnet快速下载链接 |
| ------- | ------- | | ------- | ------- |
| [gemma-2-2b]| (http://113.200.138.88:18080/aimodels/gemma-2-2b)| | gemma-2-2b| (http://113.200.138.88:18080/aimodels/gemma-2-2b)|
| [gemma-2-2b-it]| (http://113.200.138.88:18080/aimodels/gemma-2-2b-it)| | gemma-2-2b-it| (http://113.200.138.88:18080/aimodels/gemma-2-2b-it)|
| [gemma-2-9b]| (http://113.200.138.88:18080/aimodels/gemma-2-9b)| | gemma-2-9b| (http://113.200.138.88:18080/aimodels/gemma-2-9b)|
| [gemma-2-9b-it]| (http://113.200.138.88:18080/aimodels/gemma-2-9b-it)| | gemma-2-9b-it| (http://113.200.138.88:18080/aimodels/gemma-2-9b-it)|
| [gemma-2-27b]| (http://113.200.138.88:18080/aimodels/google/gemma-2-27b)| | gemma-2-27b| (http://113.200.138.88:18080/aimodels/google/gemma-2-27b)|
| [gemma-2-27b-it]| (http://113.200.138.88:18080/aimodels/gemma-2-27b-it)| | gemma-2-27b-it| (http://113.200.138.88:18080/aimodels/gemma-2-27b-it)|
| 注 | 需要修改相应模型的config.json中"attn_logit_softcapping": null ;"final_logit_softcapping": null | | 注 | 需要修改相应模型的config.json中"attn_logit_softcapping": null ;"final_logit_softcapping": null |
| ------- | ------- |
### 离线批量推理 ### 离线批量推理
```bash ```bash
python examples/offline_inference.py python examples/offline_inference.py
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment