Commits · b2e422b00c3a00ac2d833c00f8b65f08e7ceda78 · ModelZoo / ResNet50_tensorflow

03 Jun, 2020 8 commits

Adjust run_classification to support fine-tuning regression tasks. · b2e422b0
Maxim Neumann authored Jun 03, 2020
```
PiperOrigin-RevId: 314607393
```
b2e422b0
Revert "Add relative positional embedding to KerasBERT (#8617)" (#8619) · 4bb13e61
Hongkun Yu authored Jun 03, 2020
```
This reverts commit c3c2386c.
```
4bb13e61

Add relative positional embedding to KerasBERT (#8617) · c3c2386c

xinliupitt authored Jun 03, 2020

* root dir

* zone updated

* print mask

* preview emb

* tf print

* input only

* emb

* tf print

* emb after mask

* masked_softmax print

* print scores

* multi folder

* first pos emb

* check input shape

* add test temp

* import math

* two classes

* prints

* all get_pos replace

* make time scale private

* pos emb comments

* print input

* embedding_inputs

* tf shape

* dimention list

* tf_util

* print tf_util

* concise

* transformer pos change to layer

* keep length var

* length as input

* None as input

* print time signal

* print time signal

* remove print

* test input shape

* double check shape

* double check shape

* double check shape

* more test

* shape check

* shape check

* print 97 info

* print 97 info new

* test if sam

* assert same

* remove assert

* tf print same

* tf print diff

* output example

* output example

* output example

* formal test

* formal test length

* raise valurerror

* test valurerror

* double check

* comments

* remove prints

* rename relative

* delet naive test

* delete docs in xinliu branch

* code reformat

* import order

* indentation fix

* more files

* adjust char number

* disable not callable

* comment to length

* error of length unequal to input_shape

* root dir

* zone updated

* print mask

* preview emb

* tf print

* input only

* emb

* tf print

* emb after mask

* masked_softmax print

* print scores

* multi folder

* remove docs

* remove prints

* root dir

* zone updated

* print mask

* preview emb

* tf print

* input only

* emb

* tf print

* emb after mask

* masked_softmax print

* print scores

* multi folder

* remove docs

* apply revised 3 files

* rm prints

c3c2386c

Internal change · cd3c6c57
Chen Chen authored Jun 03, 2020
```
PiperOrigin-RevId: 314556957
```
cd3c6c57
Update NLP README to introduce major components. · daa1408c
Jing Li authored Jun 03, 2020
```
PiperOrigin-RevId: 314526747
```
daa1408c
Update documentation and tests of model and network for regression tasks. · d90bed2e
Maxim Neumann authored Jun 03, 2020
```
PiperOrigin-RevId: 314486753
```
d90bed2e
Internal change · 46245913
Hongkun Yu authored Jun 02, 2020
```
PiperOrigin-RevId: 314466805
```
46245913
Internal change · 20897493
Tianqi Liu authored Jun 02, 2020
```
PiperOrigin-RevId: 314451720
```
20897493

02 Jun, 2020 8 commits

Add relative positional embedding to KerasBERT (#8606) · 2db2501b

xinliupitt authored Jun 02, 2020

* root dir

* zone updated

* print mask

* preview emb

* tf print

* input only

* emb

* tf print

* emb after mask

* masked_softmax print

* print scores

* multi folder

* first pos emb

* check input shape

* add test temp

* import math

* two classes

* prints

* all get_pos replace

* make time scale private

* pos emb comments

* print input

* embedding_inputs

* tf shape

* dimention list

* tf_util

* print tf_util

* concise

* transformer pos change to layer

* keep length var

* length as input

* None as input

* print time signal

* print time signal

* remove print

* test input shape

* double check shape

* double check shape

* double check shape

* more test

* shape check

* shape check

* print 97 info

* print 97 info new

* test if sam

* assert same

* remove assert

* tf print same

* tf print diff

* output example

* output example

* output example

* formal test

* formal test length

* raise valurerror

* test valurerror

* double check

* comments

* remove prints

* rename relative

* delet naive test

* delete docs in xinliu branch

* code reformat

* import order

* indentation fix

* more files

* adjust char number

* disable not callable

* comment to length

* error of length unequal to input_shape

2db2501b

A minor change to model_training_utils of BERT. · fc724b3e
A. Unique TensorFlower authored Jun 02, 2020
```
PiperOrigin-RevId: 314417394
```
fc724b3e
Internal change · 3d99cc89
Maxim Neumann authored Jun 02, 2020
```
PiperOrigin-RevId: 314412294
```
3d99cc89
Fix total block num bug in tf2 efficientnet. · 2af9696b
A. Unique TensorFlower authored Jun 02, 2020
```
PiperOrigin-RevId: 314405729
```
2af9696b
write_meta_graph=False as we do not care the graph. · 7580f0a2
Hongkun Yu authored Jun 02, 2020
```
PiperOrigin-RevId: 314394246
```
7580f0a2
Internal change · 8eb91073
Chen Chen authored Jun 02, 2020
```
PiperOrigin-RevId: 314373769
```
8eb91073
Add unit tests for bert_models.py · c25c3e88
A. Unique TensorFlower authored Jun 01, 2020
```
PiperOrigin-RevId: 314270569
```
c25c3e88
Fix cycle deps found through github CI · 8fd10a57
Hongkun Yu authored Jun 01, 2020
```
PiperOrigin-RevId: 314254688
```
8fd10a57

01 Jun, 2020 4 commits
- Fix bad __init__ import interaction in OSS. · f464526e
  Hongkun Yu authored Jun 01, 2020
```
PiperOrigin-RevId: 314198383
```
  f464526e
- [XLNET] Fix tf.data bad usages. · 2488f2c7
  Hongkun Yu authored Jun 01, 2020
```
PiperOrigin-RevId: 314177321
```
  2488f2c7
- Move common configs to official/modeling/hyperparams. · 440e7851
  Hongkun Yu authored May 31, 2020
```
Move common configs inside base_config to config_definitions.

PiperOrigin-RevId: 314074592
```
  440e7851
- Internal change · 87ec3d2a
  Abdullah Rashwan authored May 31, 2020
```
PiperOrigin-RevId: 314002442
```
  87ec3d2a
30 May, 2020 2 commits
- Internal change · 4ce55184
  Hongkun Yu authored May 30, 2020
```
PiperOrigin-RevId: 313952251
```
  4ce55184
- adds a ClassificationHead layer · 2cf59d12
  Hongkun Yu authored May 29, 2020
```
PiperOrigin-RevId: 313906815
```
  2cf59d12
29 May, 2020 11 commits
- Internal change · b45dd807
  A. Unique TensorFlower authored May 29, 2020
```
PiperOrigin-RevId: 313867862
```
  b45dd807
- Update the README. · d2200548
  Pengchong Jin authored May 29, 2020
```
PiperOrigin-RevId: 313865079
```
  d2200548
- Moved code from TF1 to TF2 for DELF logging, testing directories and feature... · afdf2599
  BasiaFusinska authored May 29, 2020
```
Moved code from TF1 to TF2 for DELF logging, testing directories and feature extraction scripts (#8591)

* Merged commit includes the following changes:

FolderOrigin-RevId: /google/src/cloud/bfusinska/delf

* Added the import for utils
Co-authored-by: Andre Araujo <andrearaujo@google.com>
```
  afdf2599
- Proposes the full functionality of MultiHeadAttention layer. This change first... · 8a13ca4e
  Hongkun Yu authored May 29, 2020
```
Proposes the full functionality of MultiHeadAttention layer. This change first goes to model garden NLP library.

PiperOrigin-RevId: 313847485
```
  8a13ca4e
- Internal change · f2f26a8b
  Chen Chen authored May 29, 2020
```
PiperOrigin-RevId: 313812017
```
  f2f26a8b
- Update README. · f4baddb3
  Pengchong Jin authored May 29, 2020
```
PiperOrigin-RevId: 313806578
```
  f4baddb3
- Internal change. · 72587577
  Yeqing Li authored May 29, 2020
```
PiperOrigin-RevId: 313798102
```
  72587577
- Update README to include the ResNet checkpoint. · 8479cc7c
  Pengchong Jin authored May 29, 2020
```
PiperOrigin-RevId: 313794704
```
  8479cc7c
- Tensorflow 2.x ShapeMask Model. · 204c689b
  A. Unique TensorFlower authored May 28, 2020
```
PiperOrigin-RevId: 313711327
```
  204c689b
- Adds an option to control evaluation in training loop. · 8ca78e39
  Yeqing Li authored May 28, 2020
```
PiperOrigin-RevId: 313708781
```
  8ca78e39
- Internal change · 8ea058b9
  A. Unique TensorFlower authored May 28, 2020
```
PiperOrigin-RevId: 313693539
```
  8ea058b9
28 May, 2020 4 commits

Internal change · 980b27d5
Abdullah Rashwan authored May 28, 2020
```
PiperOrigin-RevId: 313662797
```
980b27d5

Deprecate old customized training loop for run_classifier.py as compile/fit... · abf60128

Hongkun Yu authored May 28, 2020

Deprecate old customized training loop for run_classifier.py as compile/fit fully satisfy needs/performance.

PiperOrigin-RevId: 313660745

abf60128

Use float32 activation in Transformer. · 94b1efc1

Reed Wanderman-Milne authored May 28, 2020

Float32 is used if the model uses mixed precision with bfloat16. Float16 activation are unchanged.

The motivation is that BERT with the LAMB optimizer with a gelu activation has an unstable loss when gelu is in bfloat16. Unfortunately, it is not easy to check if the LAMB optimizer and gelu is used, and perhaps there are other cases that work better with float32 activations instead of bfloat16 activations, so we always do the activation in float32 instead of bfloat16.

PiperOrigin-RevId: 313618322

94b1efc1

Internal change · fbec2dbe
A. Unique TensorFlower authored May 27, 2020
```
PiperOrigin-RevId: 313536026
```
fbec2dbe

27 May, 2020 3 commits
- Internal change · fad183f8
  Pengchong Jin authored May 27, 2020
```
PiperOrigin-RevId: 313475975
```
  fad183f8
- Modify `augment.transform` to use `transforms.shape.rank` instead of `tf.rank`. · 5b8d66b2
  A. Unique TensorFlower authored May 27, 2020
```
PiperOrigin-RevId: 313435294
```
  5b8d66b2
- Update classifier_trainer to allow metrics disabling for benchmarks. · a0d4ac79
  Allen Wang authored May 26, 2020
```
PiperOrigin-RevId: 313321531
```
  a0d4ac79