"tests/test_layers/test_2p5d/test_2p5d.py" did not exist on "094f9a035ce7a766fd8684af7a3dbf774cd8455e"
  • Wenhao Chen's avatar
    [chat] remove naive strategy and split colossalai strategy (#4094) · edd75a59
    Wenhao Chen authored
    * feat: remove on_learn_epoch fn as not used
    
    * revert: add _on_learn_epoch fn
    
    * to: remove the use of NaiveStrategy
    
    * test: remove NaiveStrategy tests
    
    * feat: remove NaiveStrategy
    
    * style: modify comments and params
    
    * feat: split ColossalAIStrategy into LowLevelZeroStrategy and GeminiStrategy
    
    * fix: remove naive
    
    * fix: align with modified colossal strategy
    
    * fix: fix ddp _try_init_dist arg
    edd75a59
train_peft_sft.py 8.72 KB