Commit 53543689 authored by chenzk's avatar chenzk
Browse files

Update url.md

parent e285e523
......@@ -90,7 +90,7 @@ export VLLM_RANK7_NUMA=7
| 基座模型 | | | |
| ----------------------------------------------------------------------------- | ----------------------------------------------------------------------------- | ------------------------------------------------------------------------------- | --------------------------------------------------------------------------------- |
| [internlm2-7b](http://113.200.138.88:18080/aimodels/internlm/internlm2-7b.git)  | [internlm2-20b](http://113.200.138.88:18080/aimodels/internlm/internlm2-20b.git) | [internlm2_5-7b](http://113.200.138.88:18080/aimodels/internlm/internlm2_5-7b.git) | [internlm2_5-20b](http://113.200.138.88:18080/aimodels/internlm/internlm2_5-20b.git) |
| [internlm2-7b](https://huggingface.co/internlm/internlm2-7b)  | [internlm2-20b](https://huggingface.co/internlm/internlm2-20b) | [internlm2_5-7b](https://huggingface.co/internlm/internlm2_5-7b) | [internlm2_5-20b](https://huggingface.co/internlm/internlm2_5-20b) |
### 离线批量推理
......@@ -113,10 +113,7 @@ python benchmarks/benchmark_throughput.py --num-prompts 1 --input-len 32 --outpu
2、使用数据集
下载数据集:
```bash
wget http://113.200.138.88:18080/aidatasets/anon8231489123/ShareGPT_Vicuna_unfiltered.git
```
[ShareGPT_Vicuna_unfiltered](https://huggingface.co/datasets/Aeala/ShareGPT_Vicuna_unfiltered)
```bash
python benchmarks/benchmark_throughput.py --num-prompts 1 --model internlm/internlm2_5-7b --dataset ShareGPT_V3_unfiltered_cleaned_split.json -tp 1 --trust-remote-code --enforce-eager --dtype float16
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment