Skip to content

GitLab

Switch branch/tag
  1. 09 Jul, 2021 2 commits
    • Reed Wanderman-Milne's avatar
      With float16, always use LossScaleOptimizer. · be3575f5
      Reed Wanderman-Milne authored 
      Before, it was too easy to accidentally forget to set runtime.loss_scale, which had to always be done if mixed precision is used, otherwise the model would converge to worse accuracy. Now, all that needs to be done to use mixed precision is to set runtime.mixed_precision_dtype=float16.

PiperOrigin-RevId: 383767033
      be3575f5
    • Reed Wanderman-Milne's avatar
      With float16, always use LossScaleOptimizer. · 21286f77
      Reed Wanderman-Milne authored 
      Before, it was too easy to accidentally forget to set runtime.loss_scale, which had to always be done if mixed precision is used, otherwise the model would converge to worse accuracy. Now, all that needs to be done to use mixed precision is to set runtime.mixed_precision_dtype=float16.

PiperOrigin-RevId: 383767033
      21286f77
  3. 24 Jun, 2021 2 commits
  5. 06 Apr, 2021 6 commits
  7. 22 Jan, 2021 2 commits
  9. 05 Jan, 2021 2 commits
  11. 02 Jan, 2021 2 commits
  13. 13 Nov, 2020 2 commits
  15. 30 Oct, 2020 2 commits
  17. 12 Aug, 2020 2 commits
  19. 25 Feb, 2020 1 commit