Commits · 9e3550e510a7560b596157627c18cde0b5a50e9d · ModelZoo / ResNet50_tensorflow

07 Apr, 2021 1 commit
- Minor cleanup in `projects/mobilebert/distillation.py`. · 9e3550e5
  A. Unique TensorFlower authored Apr 07, 2021
```
PiperOrigin-RevId: 367244904
```
  9e3550e5
06 Apr, 2021 2 commits

Clarify the deprecation warning for bert/ readme. · 8ccc242c
Hongkun Yu authored Apr 06, 2021
```
PiperOrigin-RevId: 367101911
```
8ccc242c

Disable temperature scaling during training. · fab47e9e

Jeremiah Liu authored Apr 05, 2021

For the `GaussianProcessClassificationHead`, the temperature scaling needs to be disabled during training to avoid unexpected modification to the learning rate, which harms model quality. (Unfortunately, this seems to require adding `training` to the `call` method).

Also set the default of `gp_cov_ridge_penalty` in `RandomFeatureGaussianProcess` to 1 to be consistent with that in the `GaussianProcessClassificationHead`.

PiperOrigin-RevId: 366917075

fab47e9e

05 Apr, 2021 2 commits

Adds `call()` method to `GaussianProcessClassificationHead`. · 2ae06c8a

Jeremiah Liu authored Apr 05, 2021

This change allows `GaussianProcessClassificationHead` to output only the predictive logits during training and evaluation (instead of outputting a tuple  `(logits, covmat)`). The goal is to make the layer more compatible with `SentencePredictionTask` and Keras' `model.fit()` API.

PiperOrigin-RevId: 366891298

2ae06c8a

Rename memory_mask to self_attention_mask; target_mask to cross_attention_mask · 6f0b84d0
Hongkun Yu authored Apr 05, 2021
```
PiperOrigin-RevId: 366883351
```
6f0b84d0

01 Apr, 2021 5 commits
- Update the gcs bucket URL of mobilebert checkpoint. · dda2343a
  Chen Chen authored Apr 01, 2021
```
PiperOrigin-RevId: 366354480
```
  dda2343a
- Open source mobilebert project. · 7687b1d3
  Chen Chen authored Apr 01, 2021
```
PiperOrigin-RevId: 366313554
```
  7687b1d3
- Internal change · 41f71f6c
  Jeremiah Liu authored Mar 31, 2021
```
PiperOrigin-RevId: 366178203
```
  41f71f6c
- Adds `mean_field_logits` function to GP layer. · fd3e8141
  Jeremiah Liu authored Mar 31, 2021
```
PiperOrigin-RevId: 366175727
```
  fd3e8141
- Adds SNGP components to the list of `__init__` exports. · 80c50b6a
  Jeremiah Liu authored Mar 31, 2021
```
PiperOrigin-RevId: 366170373
```
  80c50b6a
29 Mar, 2021 1 commit

adding `beta_1` parameter to `create_optimizer` in `optimization.py` to allow... · 1dc59163

Zachary Nado authored Mar 29, 2021

adding `beta_1` parameter to `create_optimizer` in `optimization.py` to allow for a tunable `beta_1`. Defaults to the original `0.9` to ensure existing compatibility.

PiperOrigin-RevId: 365634937

1dc59163

26 Mar, 2021 3 commits
- [nlp][progressive] Revert progressive tasks. · f7260d3e
  Frederick Liu authored Mar 26, 2021
```
PiperOrigin-RevId: 365254703
```
  f7260d3e
- [nlp][progressive] Opensource progressive tasks. · 682d18ef
  Frederick Liu authored Mar 26, 2021
```
PiperOrigin-RevId: 365242134
```
  682d18ef
- [nlp][translation] Opensource and register WMT transformer experiment · a283424a
  Frederick Liu authored Mar 25, 2021
```
PiperOrigin-RevId: 365188568
```
  a283424a
25 Mar, 2021 1 commit
- Adds unit tests for using `cls_head` in `BertClassifier`. · 026a7880
  Jeremiah Liu authored Mar 24, 2021
```
PiperOrigin-RevId: 364952108
```
  026a7880
24 Mar, 2021 1 commit
- Deprecate `network.Classification` from `BertClassifier`. · 23ef9155
  Jeremiah Liu authored Mar 23, 2021
```
PiperOrigin-RevId: 364722225
```
  23ef9155
23 Mar, 2021 1 commit
- Open source bert pretrain dataloader with dynamic sequence handling. · adff6ed3
  Hongkun Yu authored Mar 23, 2021
```
PiperOrigin-RevId: 364634581
```
  adff6ed3
22 Mar, 2021 4 commits
- Internal change · 2da86542
  Poorva Potdar authored Mar 22, 2021
```
PiperOrigin-RevId: 364378436
```
  2da86542
- Update layer documentation. · 0c48b89f
  Jeremiah Liu authored Mar 22, 2021
```
PiperOrigin-RevId: 364328905
```
  0c48b89f
- Implements `GaussianProcessClassificationHead`. · 572fafb8
  Jeremiah Liu authored Mar 21, 2021
```
PiperOrigin-RevId: 364226289
```
  572fafb8
- Minor readability improvements. · 4785b025
  Le Hou authored Mar 21, 2021
```
PiperOrigin-RevId: 364219111
```
  4785b025
20 Mar, 2021 2 commits
- Adds spectral normalization and Gaussian process layers. · acf9fd92
  Jeremiah Liu authored Mar 20, 2021
```
PiperOrigin-RevId: 364109398
```
  acf9fd92
- remove calls to metrics.result() inside the train_step · cb17f22a
  A. Unique TensorFlower authored Mar 20, 2021
```
PiperOrigin-RevId: 364096705
```
  cb17f22a
18 Mar, 2021 1 commit
- Add a unit test to demonstrate how to load an encoder through yaml and checkpoint. · 739785bb
  Hongkun Yu authored Mar 17, 2021
```
PiperOrigin-RevId: 363593694
```
  739785bb
17 Mar, 2021 1 commit
- Update TODOs for {Bert,Sentencepiece}Tokenizer.get_config(): · f84103f8
  A. Unique TensorFlower authored Mar 17, 2021
```
both are tracked in the same bug.

PiperOrigin-RevId: 363431367
```
  f84103f8
16 Mar, 2021 3 commits
- [nlp][translation] Consistently use float32 for layer norm for both encoder and decoder. · cebc9e90
  Frederick Liu authored Mar 16, 2021
```
PiperOrigin-RevId: 363233691
```
  cebc9e90
- [nlp][translation] Remove seq2seq model _dtype argument and break transformer utils dependency. · 1180f37e
  Frederick Liu authored Mar 16, 2021
```
PiperOrigin-RevId: 363121226
```
  1180f37e
- Fix AdamWeightDecay: self.gradient_clip_norm should be used. · f06dc1a6
  Hongkun Yu authored Mar 15, 2021
```
PiperOrigin-RevId: 363069319
```
  f06dc1a6
14 Mar, 2021 1 commit
- Typo reported by https://github.com/tensorflow/models/pull/9672 · a4b513b1
  Hongkun Yu authored Mar 14, 2021
```
PiperOrigin-RevId: 362836016
```
  a4b513b1
12 Mar, 2021 3 commits
- Internal change · f7ea371e
  A. Unique TensorFlower authored Mar 12, 2021
```
PiperOrigin-RevId: 362613992
```
  f7ea371e
- Use backticks to denote code spans in nlp modeling docstrings · 94dd4911
  Chen Chen authored Mar 12, 2021
```
PiperOrigin-RevId: 362610475
```
  94dd4911
- Internal change · 1160fbf0
  Chen Chen authored Mar 11, 2021
```
PiperOrigin-RevId: 362461011
```
  1160fbf0
10 Mar, 2021 1 commit
- Internal change · 5a898973
  Frederick Liu authored Mar 09, 2021
```
PiperOrigin-RevId: 361957289
```
  5a898973
09 Mar, 2021 1 commit
- Add the output projects layer in the checkpoint items of MultiClsHead. · d5d087ba
  Chen Chen authored Mar 09, 2021
```
PiperOrigin-RevId: 361916017
```
  d5d087ba
08 Mar, 2021 1 commit
- Internal change · c9be6b26
  Chen Chen authored Mar 07, 2021
```
PiperOrigin-RevId: 361482425
```
  c9be6b26
05 Mar, 2021 1 commit
- Internal change · cd4af23b
  Hongkun Yu authored Mar 05, 2021
```
PiperOrigin-RevId: 361181257
```
  cd4af23b
04 Mar, 2021 2 commits
- Internal change · d2967cfe
  Poorva Potdar authored Mar 04, 2021
```
PiperOrigin-RevId: 360985819
```
  d2967cfe
- Comment/message updates: b/181866850 tracks next steps after b/149576200. · b2c3fee4
  A. Unique TensorFlower authored Mar 04, 2021
```
PiperOrigin-RevId: 360932205
```
  b2c3fee4
03 Mar, 2021 2 commits

Pass use_experimental_api=True to mixed precision functions. · 4ab6f1b1

Reed Wanderman-Milne authored Mar 03, 2021

The default is True, but I plan on changing it to False soon. After that, I plan on removing the argument and never using the experimental API.

PiperOrigin-RevId: 360724698

4ab6f1b1

Create __init__.py · fea1bf9d
Kevin authored Mar 02, 2021
```
For pip `find_packages` to find this submodule
```
fea1bf9d