Skip to content

GitLab

Switch branch/tag
  1. 27 Aug, 2021 1 commit
  3. 06 Jun, 2021 2 commits
  5. 03 May, 2021 2 commits
  7. 29 Jan, 2021 2 commits
  9. 21 Dec, 2020 1 commit
  11. 30 Oct, 2020 2 commits
  13. 09 Oct, 2020 2 commits
  15. 29 Aug, 2020 2 commits
  17. 12 Aug, 2020 2 commits
  19. 24 Mar, 2020 1 commit
  21. 06 Mar, 2020 1 commit
    • Zongwei Zhou's avatar
      Temporarily disable explicit allreduce in BERT SQuAD · 11ccb99e
      Zongwei Zhou authored 
      In BERT SQuAD, disable explicit allreduce for now to keep the original clip_by_global_norm math. With explicit allreduce, the gradients before allreduce are scaled so even if we move clip_by_global_norm before allreduce (as in TF1 and pre-TF 2.2) it will operate on scaled gradients, the math will be changed. So with explicit allreduce, it is better to move clip_by_global_norm to after allreduce.

PiperOrigin-RevId: 299278082
      11ccb99e
  23. 05 Mar, 2020 1 commit