1. 09 Jan, 2024 1 commit
  2. 20 Nov, 2023 1 commit
    • Hongxin Liu's avatar
      [npu] add npu support for gemini and zero (#5067) · e5ce4c8e
      Hongxin Liu authored
      * [npu] setup device utils (#5047)
      
      * [npu] add npu device support
      
      * [npu] support low level zero
      
      * [test] update npu zero plugin test
      
      * [hotfix] fix import
      
      * [test] recover tests
      
      * [npu] gemini support npu (#5052)
      
      * [npu] refactor device utils
      
      * [gemini] support npu
      
      * [example] llama2+gemini support npu
      
      * [kernel] add arm cpu adam kernel (#5065)
      
      * [kernel] add arm cpu adam
      
      * [optim] update adam optimizer
      
      * [kernel] arm cpu adam remove bf16 support
      e5ce4c8e
  3. 02 Nov, 2023 1 commit
  4. 20 Oct, 2023 1 commit
  5. 17 Oct, 2023 1 commit
    • Baizhou Zhang's avatar
      [gemini] support gradient accumulation (#4869) · 21ba89ca
      Baizhou Zhang authored
      * add test
      
      * fix no_sync bug in low level zero plugin
      
      * fix test
      
      * add argument for grad accum
      
      * add grad accum in backward hook for gemini
      
      * finish implementation, rewrite tests
      
      * fix test
      
      * skip stuck model in low level zero test
      
      * update doc
      
      * optimize communication & fix gradient checkpoint
      
      * modify doc
      
      * cleaning codes
      
      * update cpu adam fp16 case
      21ba89ca