Commits · 965cc3eef54a3a173a2347fe0059a35f1e5f2496 · ModelZoo / ResNet50_tensorflow

"...git@developer.sourcefind.cn:sugon_wxj/megatron-lm.git" did not exist on "b3eea9d8bafe0391d336b8c680a69a513a7cb88d"

20 Apr, 2020 2 commits
- Set the name when creating layers.PositionEmbedding object. · 1f685c54
  Chen Chen authored Apr 20, 2020
```
PiperOrigin-RevId: 307500045
```
  1f685c54
- In BERT's export to TF Hub, fix shape propagation for seq_length. · b3377b09
  A. Unique TensorFlower authored Apr 20, 2020
```
PiperOrigin-RevId: 307425903
```
  b3377b09
19 Apr, 2020 1 commit
- Fix get_config() in ReZeroTransformer. · 295b3b4f
  Le Hou authored Apr 19, 2020
```
PiperOrigin-RevId: 307297217
```
  295b3b4f
17 Apr, 2020 4 commits
- Add TalkingHeadsAttention to README. · 85b50c88
  Chen Chen authored Apr 17, 2020
```
PiperOrigin-RevId: 307082084
```
  85b50c88
- Add ReZeroTransformer to README. · f499e880
  Le Hou authored Apr 17, 2020
```
PiperOrigin-RevId: 307079383
```
  f499e880
- Internal change · 01c4ee81
  Chen Chen authored Apr 16, 2020
```
PiperOrigin-RevId: 306986791
```
  01c4ee81
- Add ReZero support (https://arxiv.org/abs/2003.04887) · dbd74385
  Le Hou authored Apr 16, 2020
```
PiperOrigin-RevId: 306971008
```
  dbd74385
15 Apr, 2020 1 commit
- Remove __init__ in CachedAttention, which is the same as its parent class. · 3c227a73
  Hongkun Yu authored Apr 15, 2020
```
PiperOrigin-RevId: 306748161
```
  3c227a73
13 Apr, 2020 1 commit
- Internal change · 057895af
  Chen Chen authored Apr 12, 2020
```
PiperOrigin-RevId: 306182576
```
  057895af
08 Apr, 2020 2 commits
- Rename arguments of EncoderScaffold: · db6aca44
  Chen Chen authored Apr 08, 2020
```
num_output_classes -> pooled_output_dim
classification_layer_initializer -> pooler_layer_initializer

PiperOrigin-RevId: 305550415
```
  db6aca44
- Add num_summed_dimensions to get_config · f3a6500f
  Yichao 'Peak' Ji authored Apr 08, 2020
  
  f3a6500f
01 Apr, 2020 1 commit
- Add a CompiledTransformer layer, which is compiled with XLA. · a3be7365
  George Karpenkov authored Apr 01, 2020
```
PiperOrigin-RevId: 304222530
```
  a3be7365
31 Mar, 2020 2 commits
- Minor code style updates · bd64315e
  Yichao 'Peak' Ji authored Mar 31, 2020
  
  bd64315e
- Fix output shape of the position embedding layer · c93ac621
  Yichao 'Peak' Ji authored Mar 31, 2020
  
  c93ac621
27 Mar, 2020 1 commit
- Use mixed precision for gelu intermediate activation in BERT SQuAD model · 8849285f
  A. Unique TensorFlower authored Mar 27, 2020
```
PiperOrigin-RevId: 303407939
```
  8849285f
12 Mar, 2020 2 commits
- Internal change · c7adbbe4
  Hongkun Yu authored Mar 11, 2020
```
PiperOrigin-RevId: 300481917
```
  c7adbbe4
- Internal change · a12cec09
  Hongkun Yu authored Mar 11, 2020
```
PiperOrigin-RevId: 300477605
```
  a12cec09
09 Mar, 2020 1 commit
- Rename Attention to MultiheadAttention · f3a29bdd
  Hongkun Yu authored Mar 09, 2020
```
PiperOrigin-RevId: 299901483
```
  f3a29bdd
05 Mar, 2020 2 commits
- Internal change · 2565629c
  Hongkun Yu authored Mar 05, 2020
```
PiperOrigin-RevId: 299169021
```
  2565629c
- Add README files in nlp/modeling folder. · ab6d40ca
  Jing Li authored Mar 05, 2020
```
PiperOrigin-RevId: 299126470
```
  ab6d40ca
04 Mar, 2020 1 commit
- Creates a models folder to host all keras.Model end points. · 0066ae22
  Hongkun Yu authored Mar 04, 2020
```
PiperOrigin-RevId: 298905114
```
  0066ae22
03 Mar, 2020 2 commits
- Attributes->Arguments. Be consistent with keras style. · 651677f5
  Hongkun Yu authored Mar 03, 2020
```
PiperOrigin-RevId: 298692558
```
  651677f5
- Remove @tf.function(experimental_compile=True) annotation · add0620a
  George Karpenkov authored Mar 02, 2020
```
Removed with plans to re-add later once the feature stabilizes more.

PiperOrigin-RevId: 298486867
```
  add0620a
26 Feb, 2020 3 commits
- Test the Transformer layer with dynamic sequence · 2f9f2479
  George Karpenkov authored Feb 26, 2020
```
PiperOrigin-RevId: 297412889
```
  2f9f2479
- Add a class-based decorator for only adding tf.function in TF2 mode · f2cf0cf4
  George Karpenkov authored Feb 26, 2020
```
PiperOrigin-RevId: 297366405
```
  f2cf0cf4
- Do not recreate tf.function on different calls to the same layer · e0c2c302
  George Karpenkov authored Feb 26, 2020
```
PiperOrigin-RevId: 297366158
```
  e0c2c302
25 Feb, 2020 1 commit
- Only apply tf.function(experimental_compile=True) in eager mode · fe1fa6d6
  George Karpenkov authored Feb 25, 2020
```
Application in graph mode still leads to some crashes.

PiperOrigin-RevId: 297144398
```
  fe1fa6d6
21 Feb, 2020 1 commit

Enable XLA compilation using `@tf.function(experimental_compile=True) for transformer layer. · 393c1399

George Karpenkov authored Feb 21, 2020

To debug the tf.function this API can be used: https://www.tensorflow.org/api_docs/python/tf/config/experimental_run_functions_eagerly

PiperOrigin-RevId: 296458870

393c1399

13 Feb, 2020 1 commit
- Remove output_activation because it is not used anywhere. · e8140fa9
  Chen Chen authored Feb 12, 2020
```
PiperOrigin-RevId: 294813724
```
  e8140fa9
12 Feb, 2020 1 commit
- no need to use `tf.keras.backend` ops. Just use equivalent tf.* ops · 1b3b2839
  Hongkun Yu authored Feb 11, 2020
```
PiperOrigin-RevId: 294588219
```
  1b3b2839
08 Feb, 2020 1 commit
- Internal change · 347f4044
  Zongwei Zhou authored Feb 07, 2020
```
PiperOrigin-RevId: 293958491
```
  347f4044
05 Feb, 2020 1 commit

Adds return_all_encoder_outputs option to TransformerEncoder to build a... · 6d9256ce

Hongkun Yu authored Feb 05, 2020

Adds return_all_encoder_outputs option to TransformerEncoder to build a network returning all encoder layers outputs. This is useful for Transformer Seq2Seq.

PiperOrigin-RevId: 293395112

6d9256ce

04 Feb, 2020 1 commit
- Adds transformer_layers properties · fd72a90e
  Hongkun Yu authored Feb 03, 2020
```
PiperOrigin-RevId: 293081282
```
  fd72a90e
21 Jan, 2020 1 commit

Remove compute_output_shape. · 0e0a94a6

Hongkun Yu authored Jan 21, 2020

Keras: "manual" shape inference is only required if the layer is dynamic (otherwise we use TF's static shape inference capabilities)

PiperOrigin-RevId: 290821518

0e0a94a6

14 Jan, 2020 1 commit
- Internal change · f5e6e291
  A. Unique TensorFlower authored Jan 14, 2020
```
PiperOrigin-RevId: 289743636
```
  f5e6e291
08 Jan, 2020 1 commit
- Add scaffolds to default layer imports. · 3bb3f185
  A. Unique TensorFlower authored Jan 08, 2020
```
PiperOrigin-RevId: 288774884
```
  3bb3f185
07 Jan, 2020 1 commit
- Remove TimeDistributed. · 6b58625d
  Hongkun Yu authored Jan 07, 2020
```
PiperOrigin-RevId: 288554071
```
  6b58625d
19 Dec, 2019 1 commit
- Add an encoder scaffold. · 96095246
  A. Unique TensorFlower authored Dec 19, 2019
```
PiperOrigin-RevId: 286477560
```
  96095246
06 Dec, 2019 1 commit
- Internal change · 6e847fbd
  Chen Chen authored Dec 06, 2019
```
PiperOrigin-RevId: 284203261
```
  6e847fbd
05 Dec, 2019 1 commit
- Make albert_transformer_encoder*.py public available · ccf64277
  Chen Chen authored Dec 04, 2019
```
PiperOrigin-RevId: 283885197
```
  ccf64277