Commit ae16311e authored by dcuai's avatar dcuai
Browse files

Update README.md

parent 05595e25
......@@ -106,13 +106,13 @@ HIP_VISIBLE_DEVICES=0,1 llamafactory-cli train examples/train_lora/phi-4_lora_sf
```
#注意:根据自己的模型切换文件中的模型位置并调整其他参数
cd /path/your_code_data/
python ./inference_vllm/phi_single_infer.py
python ./inference/phi_single_infer.py
```
### 单机多卡
```
HIP_VISIBLE_DEVICES=0,1 python ./inference_vllm/phi_multi_infer.py
HIP_VISIBLE_DEVICES=0,1 python ./inference/phi_multi_infer.py
```
其中,tensor_parallel_size=2为使用卡数,prompt为你想输入的内容。
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment