Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
ChatGLM_vllm
Commits
da04bb08
Commit
da04bb08
authored
Nov 09, 2024
by
laibao
Browse files
Update README.md
parent
c41992e4
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
README.md
README.md
+3
-3
No files found.
README.md
View file @
da04bb08
...
@@ -82,9 +82,9 @@ conda create -n chatglm_vllm python=3.10
...
@@ -82,9 +82,9 @@ conda create -n chatglm_vllm python=3.10
| 基座模型 | 长文本模型 |
| 基座模型 | 长文本模型 |
| ------- | ------- |
| ------- | ------- |
|
[
chatglm2-6b
](
http://113.200.138.88:18080/aimodels/chatglm2-6b
)
|
[
chatglm2-6b-32k
](
http
s
://
huggingface.co/THUDM
/chatglm2-6b-32k
)
|
|
[
chatglm2-6b
](
http://113.200.138.88:18080/aimodels/chatglm2-6b
)
|
[
chatglm2-6b-32k
](
http://
113.200.138.88:18080/aimodels/thudm
/chatglm2-6b-32k
.git
)
|
|
[
chatglm3-6b
](
http://113.200.138.88:18080/aimodels/chatglm3-6b
)
|
[
chatglm3-6b-32k
](
http://113.200.138.88:18080/aimodels/chatglm3-6b-32k
)
|
|
[
chatglm3-6b
](
http://113.200.138.88:18080/aimodels/chatglm3-6b
)
|
[
chatglm3-6b-32k
](
http://113.200.138.88:18080/aimodels/chatglm3-6b-32k
)
|
|
[
glm-4-9b-chat
](
http
s
://
huggingface.co/THUDM
/glm-4-9b-chat
)
|
|
[
glm-4-9b-chat
](
http://
113.200.138.88:18080/aimodels
/glm-4-9b-chat
.git
)
|
### 离线批量推理
### 离线批量推理
```
bash
```
bash
...
@@ -104,7 +104,7 @@ python benchmarks/benchmark_throughput.py --num-prompts 1 --input-len 32 --outpu
...
@@ -104,7 +104,7 @@ python benchmarks/benchmark_throughput.py --num-prompts 1 --input-len 32 --outpu
2、使用数据集
2、使用数据集
下载数据集:
下载数据集:
```
bash
```
bash
wget http
s
://
huggingface.co/
datasets/anon8231489123/ShareGPT_Vicuna_unfiltered
/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json
wget http://
113.200.138.88:18080/ai
datasets/anon8231489123/ShareGPT_Vicuna_unfiltered
.git
```
```
```
bash
```
bash
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment