Skip to content

GitLab

Switch branch/tag
  1. 19 Aug, 2021 1 commit
  3. 16 Jul, 2021 1 commit
  5. 19 Mar, 2021 1 commit
  7. 08 Mar, 2021 1 commit
  9. 04 Mar, 2021 1 commit
  11. 23 Feb, 2021 1 commit
  13. 09 Feb, 2021 1 commit
    • Deepak Narayanan's avatar
      Interleaved pipeline execution and code refactoring · dd889062
      Deepak Narayanan authored 
      - Split a model's computation into multiple virtual stages as needed,
and schedule communication correctly between these virtual stages
- Move schedule code into `schedules.py` and communication code into
`p2p_communication.py`
- Use hyphens instead of spaces in all time logging for consistency
- Factor out code in megatron/training.py into helper functions
- Refactor evaluate() function: make it use forward_backward_schedule
functions
      dd889062
  15. 22 Jan, 2021 1 commit
  17. 08 Jan, 2021 1 commit
  19. 30 Dec, 2020 1 commit
  21. 27 Dec, 2020 1 commit
  23. 25 Dec, 2020 1 commit