Skip to content

GitLab

Switch branch/tag
  1. 08 Jun, 2022 2 commits
  3. 01 Jun, 2022 1 commit
  5. 29 Mar, 2022 2 commits
  7. 28 Mar, 2022 2 commits
  9. 23 Mar, 2022 2 commits
  11. 22 Mar, 2022 3 commits
  13. 21 Mar, 2022 1 commit
  15. 14 Mar, 2022 1 commit
  17. 09 Mar, 2022 2 commits
  19. 02 Mar, 2022 1 commit
  21. 01 Mar, 2022 2 commits
  23. 28 Feb, 2022 1 commit
  25. 18 Feb, 2022 1 commit
  27. 30 Jul, 2021 1 commit
    • Deepak Narayanan's avatar
      Support for pipeline parallelism in T5 model · 46c74b4c
      Deepak Narayanan authored 
      - Accumulate encoder hidden state gradient to handle skip connection
- Correctly compute the number of layers in encoder / decoder for T5 model
- Ensure e weights are initialized the same way in embeddings
- Synchronize embedding gradients across encoder and decoder for T5 model
- Support for checkpoint loading and saving
      46c74b4c
  29. 04 Mar, 2021 2 commits
  31. 23 Feb, 2021 1 commit
  33. 26 Jan, 2021 1 commit
  35. 06 Jan, 2021 2 commits
  37. 05 Jan, 2021 1 commit
  39. 30 Dec, 2020 1 commit