official/nlp/bert_modeling.py · 3fa65606bb7b6642d0cde13163306b692bb35a68 · ModelZoo / ResNet50_tensorflow

Bert fp16 perf improvements, do the matmul in intermediate later in fp16, and... · 3fa65606

A. Unique TensorFlower authored Oct 07, 2019

Bert fp16 perf improvements, do the matmul in intermediate later in fp16, and also remove explicit casting to fp32 for layerNorm.

PiperOrigin-RevId: 273379063

3fa65606

bert_modeling.py 35.9 KB

Replace bert_modeling.py