Skip to content

GitLab

"megatron/legacy/data/ict_dataset.py" did not exist on "03feecbca3e28ba8b95f5280fef042dba2e59b65"
Switch branch/tag
  1. 15 Apr, 2021 1 commit
  3. 13 Apr, 2021 2 commits
    • A. Unique TensorFlower's avatar
      Internal change · f4bd58dd
      A. Unique TensorFlower authored 
      PiperOrigin-RevId: 368260712
      f4bd58dd
    • Reed Wanderman-Milne's avatar
      Use nonexperimental mixed precision API. · 9a4d14a9
      Reed Wanderman-Milne authored 
      This replaces symbols in tf.keras.mixed_precision.experimental with the corresponding nonexperimental symbols. In some cases, passing a Policy is replaced with passing a policy name for conciseness.

Additionally, for the Shakespeare model, the loss_scale flag is removed, since supporting it with the nonexperimental API is slightly more verbose and it is recommended users use the default loss scale.

PiperOrigin-RevId: 368123944
      9a4d14a9
  5. 06 Apr, 2021 1 commit
    • Jeremiah Liu's avatar
      Disable temperature scaling during training. · ff3ed4cc
      Jeremiah Liu authored 
      For the `GaussianProcessClassificationHead`, the temperature scaling needs to be disabled during training to avoid unexpected modification to the learning rate, which harms model quality. (Unfortunately, this seems to require adding `training` to the `call` method).

Also set the default of `gp_cov_ridge_penalty` in `RandomFeatureGaussianProcess` to 1 to be consistent with that in the `GaussianProcessClassificationHead`.

PiperOrigin-RevId: 366917075
      ff3ed4cc
  7. 05 Apr, 2021 2 commits
  9. 01 Apr, 2021 3 commits
  11. 25 Mar, 2021 1 commit
  13. 24 Mar, 2021 1 commit
  15. 22 Mar, 2021 4 commits
  17. 20 Mar, 2021 1 commit
  19. 17 Mar, 2021 2 commits
  21. 16 Mar, 2021 4 commits
  23. 12 Mar, 2021 6 commits
  25. 10 Mar, 2021 2 commits
  27. 09 Mar, 2021 2 commits
  29. 08 Mar, 2021 2 commits
  31. 04 Mar, 2021 4 commits
  33. 02 Mar, 2021 2 commits