1. 01 May, 2020 1 commit
  2. 26 Apr, 2020 1 commit
  3. 25 Apr, 2020 1 commit
  4. 23 Apr, 2020 1 commit
  5. 22 Apr, 2020 2 commits
  6. 21 Apr, 2020 2 commits
  7. 20 Apr, 2020 2 commits
  8. 19 Apr, 2020 1 commit
  9. 17 Apr, 2020 3 commits
  10. 16 Apr, 2020 1 commit
  11. 15 Apr, 2020 3 commits
  12. 13 Apr, 2020 1 commit
  13. 10 Apr, 2020 1 commit
  14. 08 Apr, 2020 2 commits
  15. 07 Apr, 2020 1 commit
  16. 31 Mar, 2020 1 commit
  17. 27 Mar, 2020 2 commits
  18. 26 Mar, 2020 1 commit
  19. 25 Mar, 2020 1 commit
  20. 24 Mar, 2020 1 commit
  21. 19 Mar, 2020 1 commit
  22. 17 Mar, 2020 3 commits
  23. 12 Mar, 2020 1 commit
  24. 11 Mar, 2020 1 commit
  25. 07 Mar, 2020 1 commit
  26. 06 Mar, 2020 1 commit
    • Zongwei Zhou's avatar
      Temporarily disable explicit allreduce in BERT SQuAD · 11ccb99e
      Zongwei Zhou authored
      In BERT SQuAD, disable explicit allreduce for now to keep the original clip_by_global_norm math. With explicit allreduce, the gradients before allreduce are scaled so even if we move clip_by_global_norm before allreduce (as in TF1 and pre-TF 2.2) it will operate on scaled gradients, the math will be changed. So with explicit allreduce, it is better to move clip_by_global_norm to after allreduce.
      
      PiperOrigin-RevId: 299278082
      11ccb99e
  27. 05 Mar, 2020 3 commits