Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • Hongkun Yu's avatar
    Merged commit includes the following changes: (#7309) · 8c7a0e75
    Hongkun Yu authored 
    260060237  by zongweiz<zongweiz@google.com>:

    [BERT SQuAD] Enable mixed precision training

    Add mixed precision training support for BERT SQuAD model. Using the experimental Keras mixed precision API. For numeric stability, use fp32 for layer normalization, dense layers with GELU activation, etc.

--

PiperOrigin-RevId: 260060237
    8c7a0e75
modeling.py 37.5 KB