1. 04 Jul, 2023 2 commits
    • FoolPlayer's avatar
      [shardformer] Unit test (#3928) · a7313048
      FoolPlayer authored
      * fix bug in slicer, add slicer unit test
      
      * add dropout test
      
      * use pid as dropout seed
      
      * updata dropout test with local pattern
      
      * ad todo
      a7313048
    • FoolPlayer's avatar
      [shardformer] Align bert value (#3907) · f1cb5ac6
      FoolPlayer authored
      * add bert align test, fix dist loss bug
      
      * forward and backward align
      
      * add ignore index
      
      * add shardformer CI
      
      * add gather_output optional for user in shardconfig
      
      * update readme with optional gather_ouput
      
      * add dist crossentropy loss test, remove unused files
      
      * remove unused file
      
      * remove unused file
      
      * rename the file
      
      * polish code
      f1cb5ac6