Skip to content

GitLab

Commit cc824e63 authored by yuguo960516yuguo's avatar yuguo960516yuguo
Browse files

loss

parent 95306eb9
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ cc824e63
......@@ -155,7 +155,7 @@ HIP_VISIBLE_DEVICES=0,1,2,3 deepspeed --num_gpus=4 --master_port $MASTER_PORT ma
由于该示例预训练数据集较小，loss会降的至较低水平到0.1左右。
![img](http://hpczentao.sugon.com/file-read-106608.jpeg)
![img](https://developer.hpccube.com/codes/modelzoo/chatglm/-/raw/main/ptuning/logs/pretrain.jpeg)
## 强化学习(RLHF)微调方案
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment