Commits · fab47e9e105d3cc98fc04cf172fa2038607d0939 · ModelZoo / ResNet50_tensorflow

06 Apr, 2021 1 commit

Disable temperature scaling during training. · fab47e9e

Jeremiah Liu authored Apr 05, 2021

For the `GaussianProcessClassificationHead`, the temperature scaling needs to be disabled during training to avoid unexpected modification to the learning rate, which harms model quality. (Unfortunately, this seems to require adding `training` to the `call` method).

Also set the default of `gp_cov_ridge_penalty` in `RandomFeatureGaussianProcess` to 1 to be consistent with that in the `GaussianProcessClassificationHead`.

PiperOrigin-RevId: 366917075

fab47e9e

05 Apr, 2021 2 commits

Adds `call()` method to `GaussianProcessClassificationHead`. · 2ae06c8a

Jeremiah Liu authored Apr 05, 2021

This change allows `GaussianProcessClassificationHead` to output only the predictive logits during training and evaluation (instead of outputting a tuple  `(logits, covmat)`). The goal is to make the layer more compatible with `SentencePredictionTask` and Keras' `model.fit()` API.

PiperOrigin-RevId: 366891298

2ae06c8a

Rename memory_mask to self_attention_mask; target_mask to cross_attention_mask · 6f0b84d0
Hongkun Yu authored Apr 05, 2021
```
PiperOrigin-RevId: 366883351
```
6f0b84d0

01 Apr, 2021 3 commits
- Internal change · 41f71f6c
  Jeremiah Liu authored Mar 31, 2021
```
PiperOrigin-RevId: 366178203
```
  41f71f6c
- Adds `mean_field_logits` function to GP layer. · fd3e8141
  Jeremiah Liu authored Mar 31, 2021
```
PiperOrigin-RevId: 366175727
```
  fd3e8141
- Adds SNGP components to the list of `__init__` exports. · 80c50b6a
  Jeremiah Liu authored Mar 31, 2021
```
PiperOrigin-RevId: 366170373
```
  80c50b6a
25 Mar, 2021 1 commit
- Adds unit tests for using `cls_head` in `BertClassifier`. · 026a7880
  Jeremiah Liu authored Mar 24, 2021
```
PiperOrigin-RevId: 364952108
```
  026a7880
24 Mar, 2021 1 commit
- Deprecate `network.Classification` from `BertClassifier`. · 23ef9155
  Jeremiah Liu authored Mar 23, 2021
```
PiperOrigin-RevId: 364722225
```
  23ef9155
22 Mar, 2021 4 commits
- Internal change · 2da86542
  Poorva Potdar authored Mar 22, 2021
```
PiperOrigin-RevId: 364378436
```
  2da86542
- Update layer documentation. · 0c48b89f
  Jeremiah Liu authored Mar 22, 2021
```
PiperOrigin-RevId: 364328905
```
  0c48b89f
- Implements `GaussianProcessClassificationHead`. · 572fafb8
  Jeremiah Liu authored Mar 21, 2021
```
PiperOrigin-RevId: 364226289
```
  572fafb8
- Minor readability improvements. · 4785b025
  Le Hou authored Mar 21, 2021
```
PiperOrigin-RevId: 364219111
```
  4785b025
20 Mar, 2021 1 commit
- Adds spectral normalization and Gaussian process layers. · acf9fd92
  Jeremiah Liu authored Mar 20, 2021
```
PiperOrigin-RevId: 364109398
```
  acf9fd92
17 Mar, 2021 1 commit
- Update TODOs for {Bert,Sentencepiece}Tokenizer.get_config(): · f84103f8
  A. Unique TensorFlower authored Mar 17, 2021
```
both are tracked in the same bug.

PiperOrigin-RevId: 363431367
```
  f84103f8
16 Mar, 2021 2 commits
- [nlp][translation] Consistently use float32 for layer norm for both encoder and decoder. · cebc9e90
  Frederick Liu authored Mar 16, 2021
```
PiperOrigin-RevId: 363233691
```
  cebc9e90
- [nlp][translation] Remove seq2seq model _dtype argument and break transformer utils dependency. · 1180f37e
  Frederick Liu authored Mar 16, 2021
```
PiperOrigin-RevId: 363121226
```
  1180f37e
12 Mar, 2021 3 commits
- Internal change · f7ea371e
  A. Unique TensorFlower authored Mar 12, 2021
```
PiperOrigin-RevId: 362613992
```
  f7ea371e
- Use backticks to denote code spans in nlp modeling docstrings · 94dd4911
  Chen Chen authored Mar 12, 2021
```
PiperOrigin-RevId: 362610475
```
  94dd4911
- Internal change · 1160fbf0
  Chen Chen authored Mar 11, 2021
```
PiperOrigin-RevId: 362461011
```
  1160fbf0
10 Mar, 2021 1 commit
- Internal change · 5a898973
  Frederick Liu authored Mar 09, 2021
```
PiperOrigin-RevId: 361957289
```
  5a898973
09 Mar, 2021 1 commit
- Add the output projects layer in the checkpoint items of MultiClsHead. · d5d087ba
  Chen Chen authored Mar 09, 2021
```
PiperOrigin-RevId: 361916017
```
  d5d087ba
08 Mar, 2021 1 commit
- Internal change · c9be6b26
  Chen Chen authored Mar 07, 2021
```
PiperOrigin-RevId: 361482425
```
  c9be6b26
04 Mar, 2021 2 commits
- Internal change · d2967cfe
  Poorva Potdar authored Mar 04, 2021
```
PiperOrigin-RevId: 360985819
```
  d2967cfe
- Comment/message updates: b/181866850 tracks next steps after b/149576200. · b2c3fee4
  A. Unique TensorFlower authored Mar 04, 2021
```
PiperOrigin-RevId: 360932205
```
  b2c3fee4
02 Mar, 2021 1 commit
- Fix minor comment typos in BERT and MobileBERT APIs. · 4d5e9122
  A. Unique TensorFlower authored Mar 02, 2021
```
PiperOrigin-RevId: 360529962
```
  4d5e9122
26 Feb, 2021 2 commits
- Switch from python slice to tf.slice as python slice emits a · bc01957e
  Bruce Fontaine authored Feb 26, 2021
```
tf.strided_slice which is much more complicated than a tf.slice.

PiperOrigin-RevId: 359792738
```
  bc01957e
- Fix comment with path of export_tfhub_lib_test.py. · 52531231
  A. Unique TensorFlower authored Feb 26, 2021
```
PiperOrigin-RevId: 359773077
```
  52531231
23 Feb, 2021 1 commit
- convert Dimension to int to avoid "TypeError: unsupported operand type(s) for... · d2d32f46
  A. Unique TensorFlower authored Feb 23, 2021
```
convert Dimension to int to avoid "TypeError: unsupported operand type(s) for /: float and Dimension"

PiperOrigin-RevId: 358988747
```
  d2d32f46
19 Feb, 2021 1 commit
- Remove a redundant line because it is the same as line 242. · aeab8791
  A. Unique TensorFlower authored Feb 18, 2021
```
PiperOrigin-RevId: 358301569
```
  aeab8791
17 Feb, 2021 1 commit

Add segment_extractor public methods to... · 3e029d42

Chen Chen authored Feb 16, 2021

Add segment_extractor public methods to third_party/tensorflow_models/official/nlp/modeling/ops/__init__.py

PiperOrigin-RevId: 357866869

3e029d42

16 Feb, 2021 2 commits
- Add back-ticks around code in the docs of nlp modeling library, so that the... · b85f4445
  Chen Chen authored Feb 16, 2021
```
Add back-ticks around code in the docs of nlp modeling library, so that the name will get auto-linked to that api page.

PiperOrigin-RevId: 357808494
```
  b85f4445
- Don't line wrap `code` spans. · 977ba7ab
  Mark Daoust authored Feb 16, 2021
```
PiperOrigin-RevId: 357794895
```
  977ba7ab
28 Jan, 2021 1 commit
- Adds T5/MTF style relative position bias layer. · c02bca43
  Hongkun Yu authored Jan 28, 2021
```
PiperOrigin-RevId: 354401143
```
  c02bca43
25 Jan, 2021 1 commit
- Internal change · 10ec8d08
  A. Unique TensorFlower authored Jan 25, 2021
```
PiperOrigin-RevId: 353681984
```
  10ec8d08
19 Jan, 2021 1 commit
- Comment update: issue https://github.com/tensorflow/tensorflow/issues/46456 tracks · 7fcb79bb
  A. Unique TensorFlower authored Jan 18, 2021
```
what https://github.com/tensorflow/tensorflow/issues/46293 reported at first.

PiperOrigin-RevId: 352464531
```
  7fcb79bb
14 Jan, 2021 2 commits
- Add vocab_size to Tokenizer.get_special_tokens_dict() · 1fb4c559
  A. Unique TensorFlower authored Jan 14, 2021
```
PiperOrigin-RevId: 351758632
```
  1fb4c559
- Let BertTokenizer avoid the bad asset path after repeated save/load · d0393056
  A. Unique TensorFlower authored Jan 13, 2021
```
reported in https://github.com/tensorflow/tensorflow/issues/46293.

A test case is added to export_tfhub_lib_test.

PiperOrigin-RevId: 351741572
```
  d0393056
12 Jan, 2021 2 commits
- Open source text_layers.py · 184fcf84
  Chen Chen authored Jan 11, 2021
```
PiperOrigin-RevId: 351309008
```
  184fcf84
- Avoid computing mlm if inputs do not have masked_lm_positions. · 34e3de04
  Frederick Liu authored Jan 11, 2021
```
PiperOrigin-RevId: 351275455
```
  34e3de04
11 Jan, 2021 1 commit
- Add imports in official/nlp/modeling/__init__.py · 0c53959e
  A. Unique TensorFlower authored Jan 11, 2021
```
PiperOrigin-RevId: 351104401
```
  0c53959e