1. 31 May, 2023 1 commit
    • Sourab Mangrulkar's avatar
      accelerate deepspeed and gradient accumulation integrate (#23236) · a73b1d59
      Sourab Mangrulkar authored
      * mixed precision support via accelerate
      
      * fix issues
      
      * fix for the sharded ddp case
      
      * fix flax and tf failing tests
      
      * `refactor the place to create `Accelerator` object
      
      * move ddp prep to accelerate
      
      * fix 😅
      
      * resolving comments
      
      * move fsdp handling to accelerate
      
      * fixex
      
      * fix saving
      
      * shift torch dynamo handling to accelerate
      
      * shift deepspeed integration and save & load utils to accelerate
      
      * fix accelerate launcher support
      
      * oops
      
      * fix 🐛
      
      * save ckpt fix
      
      * Trigger CI
      
      * nasty 🐛 😅
      
      * as deepspeed needs grad_acc fixes, transfer grad_acc to accelerate
      
      * make tests happy
      
      * quality 
      
      * loss tracked needs to account for grad_acc
      
      * fixing the deepspeed tests
      
      * quality 
      
      * 😅😅😅
      
      * tests 😡
      
      * quality 
      
      
      
      * Trigger CI
      
      * resolve comments and fix the issue with the previous merge from branch
      
      * Trigger CI
      
      * accelerate took over deepspeed integration
      
      ---------
      Co-authored-by: default avatarStas Bekman <stas@stason.org>
      a73b1d59
  2. 14 Feb, 2023 1 commit
  3. 19 Jan, 2023 1 commit
  4. 16 Jan, 2023 1 commit
  5. 04 Jan, 2023 1 commit
  6. 08 Dec, 2022 1 commit
  7. 23 Mar, 2022 1 commit
  8. 12 Apr, 2021 1 commit
  9. 26 Mar, 2021 1 commit
  10. 17 Mar, 2021 1 commit
  11. 26 Jan, 2021 1 commit
  12. 26 Nov, 2020 1 commit
  13. 18 Nov, 2020 1 commit
  14. 09 Nov, 2020 1 commit
  15. 05 Nov, 2020 1 commit
  16. 19 Oct, 2020 1 commit
  17. 13 Oct, 2020 1 commit
  18. 28 Sep, 2020 1 commit
  19. 24 Aug, 2020 1 commit