1. 01 May, 2020 1 commit
  2. 21 Apr, 2020 1 commit
  3. 16 Apr, 2020 1 commit
  4. 14 Apr, 2020 1 commit
  5. 10 Apr, 2020 1 commit
  6. 03 Apr, 2020 1 commit
  7. 01 Apr, 2020 1 commit
  8. 26 Mar, 2020 1 commit
  9. 25 Mar, 2020 1 commit
  10. 17 Mar, 2020 3 commits
  11. 15 Mar, 2020 2 commits
  12. 13 Mar, 2020 1 commit
  13. 11 Mar, 2020 2 commits
  14. 10 Mar, 2020 1 commit
    • Ran Chen's avatar
      Save to tmp directory on non-chief workers in model_training_utils · 682d36b5
      Ran Chen authored
      In a multi worker set up saving is done on each worker. If they're saving to the same location, e.g. GCS, there will be conflicts. With this change we save to temporary directory on non-chief workers.
      
      Note that, there may be synchronization in saving that needs all workers to participate, so we cannot only save on one worker.
      
      PiperOrigin-RevId: 300141152
      682d36b5
  15. 07 Mar, 2020 1 commit
  16. 06 Mar, 2020 1 commit
    • Zongwei Zhou's avatar
      Temporarily disable explicit allreduce in BERT SQuAD · 11ccb99e
      Zongwei Zhou authored
      In BERT SQuAD, disable explicit allreduce for now to keep the original clip_by_global_norm math. With explicit allreduce, the gradients before allreduce are scaled so even if we move clip_by_global_norm before allreduce (as in TF1 and pre-TF 2.2) it will operate on scaled gradients, the math will be changed. So with explicit allreduce, it is better to move clip_by_global_norm to after allreduce.
      
      PiperOrigin-RevId: 299278082
      11ccb99e
  17. 05 Mar, 2020 1 commit
  18. 04 Mar, 2020 1 commit
  19. 03 Mar, 2020 1 commit
  20. 02 Mar, 2020 2 commits
  21. 28 Feb, 2020 1 commit
  22. 26 Feb, 2020 1 commit
  23. 25 Feb, 2020 2 commits
  24. 20 Feb, 2020 1 commit
  25. 19 Feb, 2020 2 commits
  26. 13 Feb, 2020 1 commit
  27. 12 Feb, 2020 1 commit
  28. 07 Feb, 2020 1 commit
  29. 27 Jan, 2020 1 commit
  30. 16 Jan, 2020 1 commit
  31. 06 Jan, 2020 1 commit
  32. 31 Dec, 2019 1 commit
  33. 04 Dec, 2019 1 commit