Commit 37ec78ae authored by laibao's avatar laibao
Browse files

No commit message

No commit message
parent c115d823
......@@ -94,7 +94,7 @@ conda create -n qwen2.5_vllm python=3.10
### 离线批量推理
```bash
-python examples/offline_inference.py
python examples/offline_inference.py
```
其中,`prompts`为提示词;`temperature`为控制采样随机性的值,值越小模型生成越确定,值变高模型生成更随机,0表示贪婪采样,默认为1;`max_tokens=16`为生成长度,默认为1;
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment