Skip to content

GitLab

Switch branch/tag
  1. 04 Nov, 2021 1 commit
  3. 02 Nov, 2021 1 commit
  5. 26 Oct, 2021 1 commit
  7. 24 Sep, 2021 4 commits
  9. 23 Sep, 2021 2 commits
  11. 22 Sep, 2021 2 commits
  13. 17 Sep, 2021 2 commits
  15. 08 Aug, 2021 2 commits
  17. 05 Aug, 2021 4 commits
  19. 24 Jul, 2021 2 commits
  21. 23 Jul, 2021 2 commits
  23. 21 Jul, 2021 2 commits
  25. 20 Jul, 2021 2 commits
  27. 15 Jul, 2021 2 commits
  29. 13 Jul, 2021 2 commits
  31. 09 Jul, 2021 2 commits
    • Reed Wanderman-Milne's avatar
      With float16, always use LossScaleOptimizer. · be3575f5
      Reed Wanderman-Milne authored 
      Before, it was too easy to accidentally forget to set runtime.loss_scale, which had to always be done if mixed precision is used, otherwise the model would converge to worse accuracy. Now, all that needs to be done to use mixed precision is to set runtime.mixed_precision_dtype=float16.

PiperOrigin-RevId: 383767033
      be3575f5
    • Reed Wanderman-Milne's avatar
      With float16, always use LossScaleOptimizer. · 21286f77
      Reed Wanderman-Milne authored 
      Before, it was too easy to accidentally forget to set runtime.loss_scale, which had to always be done if mixed precision is used, otherwise the model would converge to worse accuracy. Now, all that needs to be done to use mixed precision is to set runtime.mixed_precision_dtype=float16.

PiperOrigin-RevId: 383767033
      21286f77
  33. 24 Jun, 2021 2 commits
  35. 23 Jun, 2021 2 commits
    • Reed Wanderman-Milne's avatar
      Improve error message when certain flags are not specified. · 8b47c484
      Reed Wanderman-Milne authored 
      In nlp/train.py and vision/beta/train.py, certain flags are marked as required. Additionally, in certain functions, error messages are improved if a necessary flag is not specified, which is a fallback in case a file calling define_flags() does not mark the necessary flags are required. Previously if any of these flags were not specified, it would crash with a cryptic error message, making it hard to tell what went wrong.

In a subsequent change, I will mark flags as required in more files which call define_flags().

PiperOrigin-RevId: 381066985
      8b47c484
    • Reed Wanderman-Milne's avatar
      Improve error message when certain flags are not specified. · 0a9026e4
      Reed Wanderman-Milne authored 
      In nlp/train.py and vision/beta/train.py, certain flags are marked as required. Additionally, in certain functions, error messages are improved if a necessary flag is not specified, which is a fallback in case a file calling define_flags() does not mark the necessary flags are required. Previously if any of these flags were not specified, it would crash with a cryptic error message, making it hard to tell what went wrong.

In a subsequent change, I will mark flags as required in more files which call define_flags().

PiperOrigin-RevId: 381066985
      0a9026e4
  37. 22 Jun, 2021 2 commits
  39. 20 Jun, 2021 1 commit