Skip to content

GitLab

Commit 744ec16e authored by zhaoying1's avatar zhaoying1
Browse files

Update README.md

parent 92060602
Hide whitespace changes
Inline Side-by-side
Showing with 14 additions and 12 deletions
README.md
View file @ 744ec16e
...@@ -123,18 +123,7 @@ Hugging Face模型下载地址： ...@@ -123,18 +123,7 @@ Hugging Face模型下载地址：
cd ptuning cd ptuning
bash evaluate_ft.sh bash evaluate_ft.sh
``` ```
### Results
## LoRA 微调训练
### 单机多卡训练
```
cd ptuning
bash lora_train.sh
```
### LoRA推理
```
python infer_lora.py
```
## Results
- 训练Loss - 训练Loss
<div align="center"> <div align="center">
<img src="./ptuning/media/6B_ds_ft_bs32_accum1_4cards_zero3_5e-5.jpg" width="400" height="300"> <img src="./ptuning/media/6B_ds_ft_bs32_accum1_4cards_zero3_5e-5.jpg" width="400" height="300">
...@@ -157,6 +146,19 @@ Hugging Face模型下载地址： ...@@ -157,6 +146,19 @@ Hugging Face模型下载地址：
| Training Loss | 3.00 | 3.57 | 3.32 | --> | Training Loss | 3.00 | 3.57 | 3.32 | -->
## LoRA 微调训练
### 单机多卡训练
```
cd ptuning
bash lora_train.sh
```
### LoRA推理
```
python infer_lora.py
```
## 推理 ## 推理
运行如下命令： 运行如下命令：
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment