更新llama预训练脚本

12 jobs for !4 with main
latest detached
Status Job ID Name Coverage
  Test
canceled #11764
ssh_selene_runner
resume.checkpoint.bert.345m_tp1_pp2_1node

canceled #11759
ssh_selene_runner
resume.checkpoint.gpt3.345m_tp1_pp2_1node

canceled #11762
ssh_selene_runner
train.bert.345m_tp1_pp2_1node_50steps

canceled #11763
ssh_selene_runner
train.bert.345m_tp1_pp4_1node_50steps

canceled #11761
ssh_selene_runner
train.bert.345m_tp2_pp2_1node_50steps

canceled #11760
ssh_selene_runner
train.bert.345m_tp4_pp1_1node_50steps

canceled #11757
ssh_selene_runner
train.gpt3.345m_tp1_pp2_1node_50steps

canceled #11758
ssh_selene_runner
train.gpt3.345m_tp1_pp4_1node_50steps

canceled #11756
ssh_selene_runner
train.gpt3.345m_tp2_pp2_1node_50steps

canceled #11755
ssh_selene_runner
train.gpt3.345m_tp4_pp1_1node_50steps

canceled #11754
docker_local_runner
unit_tests

 
  Cleanup
canceled #11765
ssh_selene_runner allowed to fail
cleanup.selene