1. 30 Mar, 2023 1 commit
  2. 19 Nov, 2021 1 commit
  3. 15 Nov, 2021 1 commit
  4. 23 Jun, 2021 2 commits
    • Reed Wanderman-Milne's avatar
      Return default strategy from get_distribution_strategy when given "off". · 9f9d07e9
      Reed Wanderman-Milne authored
      Before, it returned None. But almost every use of get_distribution_strategy() assumes an actual strategy is returned and crashes when None is returned. Returning the default strategy fixes these issues and is equivalent to using no strategy, as the default strategy is always in effect when no other strategy is used.
      
      PiperOrigin-RevId: 380951055
      9f9d07e9
    • Reed Wanderman-Milne's avatar
      Return default strategy from get_distribution_strategy when given "off". · 6dc4ae73
      Reed Wanderman-Milne authored
      Before, it returned None. But almost every use of get_distribution_strategy() assumes an actual strategy is returned and crashes when None is returned. Returning the default strategy fixes these issues and is equivalent to using no strategy, as the default strategy is always in effect when no other strategy is used.
      
      PiperOrigin-RevId: 380951055
      6dc4ae73
  5. 25 Feb, 2021 2 commits
  6. 05 Jan, 2021 2 commits
  7. 29 Dec, 2020 2 commits
  8. 13 Sep, 2020 2 commits
  9. 12 Aug, 2020 2 commits
  10. 30 Mar, 2020 1 commit
  11. 13 Feb, 2020 1 commit
  12. 29 Apr, 2019 1 commit
  13. 28 Feb, 2019 1 commit
  14. 13 Feb, 2019 1 commit
  15. 21 Nov, 2018 1 commit
  16. 14 Nov, 2018 1 commit
  17. 24 Oct, 2018 1 commit
  18. 18 Oct, 2018 1 commit
  19. 12 Jun, 2018 1 commit
    • Katherine Wu's avatar
      Transformer multi gpu, remove multi_gpu flag, distribution helper functions (#4457) · 29c9f985
      Katherine Wu authored
      * Add DistributionStrategy to transformer model
      
      * add num_gpu flag
      
      * Calculate per device batch size for transformer
      
      * remove reference to flags_core
      
      * Add synthetic data option to transformer
      
      * fix typo
      
      * add import back in
      
      * Use hierarchical copy
      
      * address PR comments
      
      * lint
      
      * fix spaces
      
      * group train op together to fix single GPU error
      
      * Fix translate bug (sorted_keys is a dict, not a list)
      
      * Change params to a default dict (translate.py was throwing errors because params didn't have the TPU parameters.)
      
      * Address PR comments. Removed multi gpu flag + more
      
      * fix lint
      
      * fix more lints
      
      * add todo for Synthetic dataset
      
      * Update docs
      29c9f985