1. 06 Mar, 2020 1 commit
    • Zongwei Zhou's avatar
      Temporarily disable explicit allreduce in BERT SQuAD · 11ccb99e
      Zongwei Zhou authored
      In BERT SQuAD, disable explicit allreduce for now to keep the original clip_by_global_norm math. With explicit allreduce, the gradients before allreduce are scaled so even if we move clip_by_global_norm before allreduce (as in TF1 and pre-TF 2.2) it will operate on scaled gradients, the math will be changed. So with explicit allreduce, it is better to move clip_by_global_norm to after allreduce.
      
      PiperOrigin-RevId: 299278082
      11ccb99e
  2. 05 Mar, 2020 1 commit
  3. 04 Mar, 2020 1 commit
  4. 03 Mar, 2020 1 commit
  5. 02 Mar, 2020 2 commits
  6. 28 Feb, 2020 1 commit
  7. 26 Feb, 2020 1 commit
  8. 25 Feb, 2020 2 commits
  9. 20 Feb, 2020 1 commit
  10. 19 Feb, 2020 2 commits
  11. 13 Feb, 2020 1 commit
  12. 12 Feb, 2020 1 commit
  13. 07 Feb, 2020 1 commit
  14. 27 Jan, 2020 1 commit
  15. 16 Jan, 2020 1 commit
  16. 06 Jan, 2020 1 commit
  17. 31 Dec, 2019 1 commit
  18. 04 Dec, 2019 1 commit
  19. 23 Nov, 2019 1 commit
  20. 18 Nov, 2019 2 commits
  21. 08 Nov, 2019 1 commit
  22. 07 Nov, 2019 1 commit
  23. 06 Nov, 2019 1 commit
  24. 31 Oct, 2019 1 commit
  25. 29 Oct, 2019 1 commit
  26. 28 Oct, 2019 2 commits
  27. 21 Oct, 2019 2 commits
  28. 18 Oct, 2019 1 commit
  29. 16 Oct, 2019 1 commit
  30. 15 Oct, 2019 1 commit
  31. 11 Oct, 2019 1 commit
  32. 10 Oct, 2019 2 commits
  33. 07 Oct, 2019 1 commit