Commits · fbec2dbe9c3fa7a19d0df3ce535fa6f45a7f8473 · ModelZoo / ResNet50_tensorflow

19 May, 2020 1 commit
- Allows to customize feedforward layer in transformer_scaffold. · d9c4e454
  Chen Chen authored May 19, 2020
```
PiperOrigin-RevId: 312366167
```
  d9c4e454
18 May, 2020 1 commit
- Internal Change · 6f7a682d
  Chen Chen authored May 18, 2020
```
PiperOrigin-RevId: 312116965
```
  6f7a682d
17 May, 2020 1 commit
- Update nlp.modeling.layers.ReZeroTransformer, to have the same interface with... · ef61bae9
  A. Unique TensorFlower authored May 16, 2020
```
Update nlp.modeling.layers.ReZeroTransformer, to have the same interface with nlp.modeling.layers.Transformer

PiperOrigin-RevId: 311937563
```
  ef61bae9
12 May, 2020 3 commits
- Fixes a typo. · 3ae3aecf
  A. Unique TensorFlower authored May 12, 2020
```
PiperOrigin-RevId: 311196489
```
  3ae3aecf
- Make Transformer Layer back compatible. · ac5fff19
  Hongkun Yu authored May 12, 2020
```
PiperOrigin-RevId: 311165658
```
  ac5fff19
- Internal Change · 2878da2e
  Chen Chen authored May 12, 2020
```
PiperOrigin-RevId: 311072125
```
  2878da2e
10 May, 2020 1 commit
- Internal change · 09c5ae2f
  Hongkun Yu authored May 09, 2020
```
PiperOrigin-RevId: 310767440
```
  09c5ae2f
05 May, 2020 1 commit
- Introduce output_range for transformer layer and encoder last layer. · 563d923a
  Hongkun Yu authored May 05, 2020
```
PiperOrigin-RevId: 310032518
```
  563d923a
21 Apr, 2020 1 commit
- Internal change · 330b34fe
  Hongkun Yu authored Apr 21, 2020
```
PiperOrigin-RevId: 307689094
```
  330b34fe
20 Apr, 2020 1 commit
- In BERT's export to TF Hub, fix shape propagation for seq_length. · b3377b09
  A. Unique TensorFlower authored Apr 20, 2020
```
PiperOrigin-RevId: 307425903
```
  b3377b09
19 Apr, 2020 1 commit
- Fix get_config() in ReZeroTransformer. · 295b3b4f
  Le Hou authored Apr 19, 2020
```
PiperOrigin-RevId: 307297217
```
  295b3b4f
17 Apr, 2020 4 commits
- Add TalkingHeadsAttention to README. · 85b50c88
  Chen Chen authored Apr 17, 2020
```
PiperOrigin-RevId: 307082084
```
  85b50c88
- Add ReZeroTransformer to README. · f499e880
  Le Hou authored Apr 17, 2020
```
PiperOrigin-RevId: 307079383
```
  f499e880
- Internal change · 01c4ee81
  Chen Chen authored Apr 16, 2020
```
PiperOrigin-RevId: 306986791
```
  01c4ee81
- Add ReZero support (https://arxiv.org/abs/2003.04887) · dbd74385
  Le Hou authored Apr 16, 2020
```
PiperOrigin-RevId: 306971008
```
  dbd74385
15 Apr, 2020 1 commit
- Remove __init__ in CachedAttention, which is the same as its parent class. · 3c227a73
  Hongkun Yu authored Apr 15, 2020
```
PiperOrigin-RevId: 306748161
```
  3c227a73
13 Apr, 2020 1 commit
- Internal change · 057895af
  Chen Chen authored Apr 12, 2020
```
PiperOrigin-RevId: 306182576
```
  057895af
08 Apr, 2020 1 commit
- Add num_summed_dimensions to get_config · f3a6500f
  Yichao 'Peak' Ji authored Apr 08, 2020
  
  f3a6500f
01 Apr, 2020 1 commit
- Add a CompiledTransformer layer, which is compiled with XLA. · a3be7365
  George Karpenkov authored Apr 01, 2020
```
PiperOrigin-RevId: 304222530
```
  a3be7365
31 Mar, 2020 2 commits
- Minor code style updates · bd64315e
  Yichao 'Peak' Ji authored Mar 31, 2020
  
  bd64315e
- Fix output shape of the position embedding layer · c93ac621
  Yichao 'Peak' Ji authored Mar 31, 2020
  
  c93ac621
27 Mar, 2020 1 commit
- Use mixed precision for gelu intermediate activation in BERT SQuAD model · 8849285f
  A. Unique TensorFlower authored Mar 27, 2020
```
PiperOrigin-RevId: 303407939
```
  8849285f
12 Mar, 2020 1 commit
- Internal change · a12cec09
  Hongkun Yu authored Mar 11, 2020
```
PiperOrigin-RevId: 300477605
```
  a12cec09
09 Mar, 2020 1 commit
- Rename Attention to MultiheadAttention · f3a29bdd
  Hongkun Yu authored Mar 09, 2020
```
PiperOrigin-RevId: 299901483
```
  f3a29bdd
05 Mar, 2020 2 commits
- Internal change · 2565629c
  Hongkun Yu authored Mar 05, 2020
```
PiperOrigin-RevId: 299169021
```
  2565629c
- Add README files in nlp/modeling folder. · ab6d40ca
  Jing Li authored Mar 05, 2020
```
PiperOrigin-RevId: 299126470
```
  ab6d40ca
03 Mar, 2020 2 commits
- Attributes->Arguments. Be consistent with keras style. · 651677f5
  Hongkun Yu authored Mar 03, 2020
```
PiperOrigin-RevId: 298692558
```
  651677f5
- Remove @tf.function(experimental_compile=True) annotation · add0620a
  George Karpenkov authored Mar 02, 2020
```
Removed with plans to re-add later once the feature stabilizes more.

PiperOrigin-RevId: 298486867
```
  add0620a
26 Feb, 2020 3 commits
- Test the Transformer layer with dynamic sequence · 2f9f2479
  George Karpenkov authored Feb 26, 2020
```
PiperOrigin-RevId: 297412889
```
  2f9f2479
- Add a class-based decorator for only adding tf.function in TF2 mode · f2cf0cf4
  George Karpenkov authored Feb 26, 2020
```
PiperOrigin-RevId: 297366405
```
  f2cf0cf4
- Do not recreate tf.function on different calls to the same layer · e0c2c302
  George Karpenkov authored Feb 26, 2020
```
PiperOrigin-RevId: 297366158
```
  e0c2c302
25 Feb, 2020 1 commit
- Only apply tf.function(experimental_compile=True) in eager mode · fe1fa6d6
  George Karpenkov authored Feb 25, 2020
```
Application in graph mode still leads to some crashes.

PiperOrigin-RevId: 297144398
```
  fe1fa6d6
21 Feb, 2020 1 commit

Enable XLA compilation using `@tf.function(experimental_compile=True) for transformer layer. · 393c1399

George Karpenkov authored Feb 21, 2020

To debug the tf.function this API can be used: https://www.tensorflow.org/api_docs/python/tf/config/experimental_run_functions_eagerly

PiperOrigin-RevId: 296458870

393c1399

08 Feb, 2020 1 commit
- Internal change · 347f4044
  Zongwei Zhou authored Feb 07, 2020
```
PiperOrigin-RevId: 293958491
```
  347f4044
21 Jan, 2020 1 commit

Remove compute_output_shape. · 0e0a94a6

Hongkun Yu authored Jan 21, 2020

Keras: "manual" shape inference is only required if the layer is dynamic (otherwise we use TF's static shape inference capabilities)

PiperOrigin-RevId: 290821518

0e0a94a6

08 Jan, 2020 1 commit
- Add scaffolds to default layer imports. · 3bb3f185
  A. Unique TensorFlower authored Jan 08, 2020
```
PiperOrigin-RevId: 288774884
```
  3bb3f185
19 Dec, 2019 1 commit
- Add an encoder scaffold. · 96095246
  A. Unique TensorFlower authored Dec 19, 2019
```
PiperOrigin-RevId: 286477560
```
  96095246
04 Dec, 2019 1 commit
- Internal change · f3a61a49
  A. Unique TensorFlower authored Dec 04, 2019
```
PiperOrigin-RevId: 283778598
```
  f3a61a49
25 Nov, 2019 1 commit
- Implement CachedAttention layer. This is useful for decoders. · 0b579232
  Hongkun Yu authored Nov 25, 2019
```
PiperOrigin-RevId: 282439719
```
  0b579232
20 Nov, 2019 1 commit
- Internal change · e16594d1
  Chen Chen authored Nov 20, 2019
```
PiperOrigin-RevId: 281473612
```
  e16594d1