Update train_mixtral_8x7B_2nodes.sh

11 jobs for main in 0 seconds (queued for 62 minutes and 42 seconds)
Status Job ID Name Coverage
  Test
failed #15516
ssh_selene_runner
resume.checkpoint.bert.345m_tp1_pp2_1node

failed #15511
ssh_selene_runner
resume.checkpoint.gpt3.345m_tp1_pp2_1node

failed #15514
ssh_selene_runner
train.bert.345m_tp1_pp2_1node_50steps

failed #15515
ssh_selene_runner
train.bert.345m_tp1_pp4_1node_50steps

failed #15513
ssh_selene_runner
train.bert.345m_tp2_pp2_1node_50steps

failed #15512
ssh_selene_runner
train.bert.345m_tp4_pp1_1node_50steps

failed #15509
ssh_selene_runner
train.gpt3.345m_tp1_pp2_1node_50steps

failed #15510
ssh_selene_runner
train.gpt3.345m_tp1_pp4_1node_50steps

failed #15508
ssh_selene_runner
train.gpt3.345m_tp2_pp2_1node_50steps

failed #15507
ssh_selene_runner
train.gpt3.345m_tp4_pp1_1node_50steps

 
  Cleanup
failed #15517
ssh_selene_runner allowed to fail
cleanup.selene

 
Name Stage Failure
failed
train.gpt3.345m_tp2_pp2_1node_50steps Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
train.gpt3.345m_tp1_pp4_1node_50steps Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
train.bert.345m_tp1_pp4_1node_50steps Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
train.bert.345m_tp4_pp1_1node_50steps Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
train.gpt3.345m_tp1_pp2_1node_50steps Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
train.bert.345m_tp2_pp2_1node_50steps Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
train.bert.345m_tp1_pp2_1node_50steps Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
train.gpt3.345m_tp4_pp1_1node_50steps Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
resume.checkpoint.gpt3.345m_tp1_pp2_1node Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
resume.checkpoint.bert.345m_tp1_pp2_1node Test There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log
failed
cleanup.selene Cleanup There has been a timeout failure or the job got stuck. Check your timeout limits or try again
No job log