Skip to content

GitLab

Switch branch/tag
  1. 05 Feb, 2019 1 commit
    • Jerry Ma's avatar
      Better FP16 support in pytorch fp16 utils. · 713e0fb8
      Jerry Ma authored 
      This commit adds an FP16Model class as a successor to network_to_half.

The benefits of this class are:

- Preservation of single-precision for BatchNorm layers. The models
  generated by network_to_half() convert BatchNorm moment tensors to
  half-precision, then back to single-precision, which hurts the
  accuracy of the moment estimators and occasionally results in NaNs.
- Support for multi-argument nn.Modules (self-explanatory from code).
      713e0fb8
  3. 18 May, 2018 1 commit
  5. 25 Apr, 2018 1 commit