Commits · e353e4e59fb3fb3f0659e0e83a66b4578495ebba · ModelZoo / ResNet50_tensorflow

09 Apr, 2021 1 commit

Remove dynamic_loss_scale argument to define_performance. · e353e4e5

Reed Wanderman-Milne authored Apr 09, 2021

All models which support loss scaling support dynamic loss scaling, so the argument has no purpose. It used to be that some models scaled the loss manually instead of using a LossScaleOptimizer, and so did not support dynamic loss scaling.

PiperOrigin-RevId: 367719521

e353e4e5

10 Mar, 2021 1 commit
- Internal change · 5a898973
  Frederick Liu authored Mar 09, 2021
```
PiperOrigin-RevId: 361957289
```
  5a898973
29 Aug, 2020 1 commit
- Internal change · 3f8132e9
  Zongwei Zhou authored Aug 28, 2020
```
PiperOrigin-RevId: 329042049
```
  3f8132e9
28 Aug, 2020 1 commit
- [Minor Cleanup] Move clip_by_global_norm_callback to model_training_utils · 88effbc3
  Hongkun Yu authored Aug 27, 2020
```
PiperOrigin-RevId: 328888268
```
  88effbc3
27 Aug, 2020 1 commit
- Internal change · 3fc70674
  Zongwei Zhou authored Aug 27, 2020
```
PiperOrigin-RevId: 328842362
```
  3fc70674
12 Aug, 2020 2 commits
- Internal change · 999fae62
  Hongkun Yu authored Aug 12, 2020
```
PiperOrigin-RevId: 326286926
```
  999fae62
- Internal change · 88253ce5
  Hongkun Yu authored Aug 12, 2020
```
PiperOrigin-RevId: 326286926
```
  88253ce5
26 May, 2020 1 commit

Add --sub_model_export_name to run_classifier and run_squad. · 38800db3

André Susano Pinto authored May 26, 2020

This allows one to finetune a BERT model into a task before using it for
another task. E.g. SQuAD before finetune another QA type of tasks.

PiperOrigin-RevId: 313145768

38800db3

19 May, 2020 1 commit

When not specified by user, make steps_per_loop be dependent on the devices available. · 866176ea

André Susano Pinto authored May 19, 2020

A default of 1 all the times is bad for TPU users which end up not using the device effectively.
A larger default all the times is bad for GPU users.

So compromise and make this dependent on the devices available.

PiperOrigin-RevId: 312230371

866176ea

04 May, 2020 1 commit

Move gin flags to hyperparams_flags are they are in the same category and we... · d93a1206

Hongkun Yu authored May 04, 2020

Move gin flags to hyperparams_flags are they are in the same category and we will use them more widely.

PiperOrigin-RevId: 309779408

d93a1206

17 Apr, 2020 1 commit
- Remove hooks. · 2ddd716e
  Hongkun Yu authored Apr 16, 2020
```
PiperOrigin-RevId: 306994199
```
  2ddd716e
10 Apr, 2020 1 commit
- Add end learning rate (end_lr) FLAG for linear learning rate decay. · 22de957a
  A. Unique TensorFlower authored Apr 10, 2020
```
PiperOrigin-RevId: 305948522
```
  22de957a
27 Mar, 2020 1 commit
- Support Lamb optimizer within BERT. · da5860f2
  A. Unique TensorFlower authored Mar 27, 2020
```
PiperOrigin-RevId: 303356961
```
  da5860f2
25 Mar, 2020 1 commit
- Internal change · 38486725
  Hongkun Yu authored Mar 25, 2020
```
PiperOrigin-RevId: 302977474
```
  38486725
11 Mar, 2020 1 commit
- Add TimeHistory callback to BERT. · b39958cf
  Will Cromar authored Mar 11, 2020
```
PiperOrigin-RevId: 300433601
```
  b39958cf
07 Mar, 2020 1 commit
- Add TimeHistory callback to BERT. · 7d86c317
  Hongkun Yu authored Mar 07, 2020
```
PiperOrigin-RevId: 299594839
```
  7d86c317
05 Mar, 2020 1 commit
- Internal change · 2565629c
  Hongkun Yu authored Mar 05, 2020
```
PiperOrigin-RevId: 299169021
```
  2565629c
02 Mar, 2020 1 commit
- Add TimeHistory callback to BERT. · 533d1e6b
  Will Cromar authored Mar 02, 2020
```
PiperOrigin-RevId: 298466825
```
  533d1e6b
26 Feb, 2020 1 commit
- Internal change · ce83a9db
  Hongkun Yu authored Feb 26, 2020
```
PiperOrigin-RevId: 297383836
```
  ce83a9db
25 Feb, 2020 2 commits
- Internal change · 2781377d
  Zongwei Zhou authored Feb 25, 2020
```
PiperOrigin-RevId: 297222995
```
  2781377d
- Creates modeling/performance.py to include mix prediction related stuff · fb35d6be
  Hongkun Yu authored Feb 24, 2020
```
PiperOrigin-RevId: 297002741
```
  fb35d6be
24 Feb, 2020 1 commit
- Branch a run_squad.py for albert. · 02d78796
  Chen Chen authored Feb 24, 2020
```
PiperOrigin-RevId: 296933982
```
  02d78796
18 Feb, 2020 1 commit
- Internal change · 2926ba69
  A. Unique TensorFlower authored Feb 18, 2020
```
PiperOrigin-RevId: 295757618
```
  2926ba69
30 Jan, 2020 1 commit
- BERT enable gpu thread mode as "gpu_private" for 8-GPU runs. · 2741cc5f
  A. Unique TensorFlower authored Jan 30, 2020
```
PiperOrigin-RevId: 292369407
```
  2741cc5f
28 Jan, 2020 2 commits
- Enable all_reduce_alg flag · 4f3acbda
  Zongwei Zhou authored Jan 28, 2020
```
PiperOrigin-RevId: 292029030
```
  4f3acbda
- Add multi-worker dist-strat benchmark/accuracy for BERT SQUAD model. · d4ef56b1
  Yanhui Liang authored Jan 27, 2020
```
PiperOrigin-RevId: 291851815
```
  d4ef56b1
10 Dec, 2019 1 commit
- Internal change · f7fd59b8
  Chen Chen authored Dec 10, 2019
```
PiperOrigin-RevId: 284792715
```
  f7fd59b8
19 Nov, 2019 1 commit
- Use flags utils and distribution_utils · 252e6384
  Hongkun Yu authored Nov 19, 2019
```
PiperOrigin-RevId: 281337671
```
  252e6384
05 Nov, 2019 1 commit
- Fix a comment. · 0203278a
  Hongkun Yu authored Nov 05, 2019
```
PiperOrigin-RevId: 278672795
```
  0203278a
11 Oct, 2019 1 commit
- Bert Hub usage for squad · 223f5148
  Hongkun Yu authored Oct 10, 2019
```
PiperOrigin-RevId: 274090672
```
  223f5148
09 Oct, 2019 1 commit
- Internal change · 7207422d
  A. Unique TensorFlower authored Oct 08, 2019
```
PiperOrigin-RevId: 273653001
```
  7207422d
17 Sep, 2019 1 commit
- Move Bert to NLP. Tasks are moved to nlp/bert/ · 1862b9c3
  Hongkun Yu authored Sep 17, 2019
```
Refactor basic utils to modeling/

PiperOrigin-RevId: 269600561
```
  1862b9c3
04 Sep, 2019 1 commit
- move collection trainable variables outside loop. · a009f4fb
  Hongkun Yu authored Sep 03, 2019
```
add a flag to control loss scaling.

PiperOrigin-RevId: 267091566
```
  a009f4fb
03 Sep, 2019 1 commit
- adding fp16 implementation for BERT · 0f6ff657
  Vinh Nguyen authored Sep 03, 2019
  
  0f6ff657
26 Aug, 2019 1 commit
- Internal change · f93229b9
  Hongkun Yu authored Aug 26, 2019
```
PiperOrigin-RevId: 265510206
```
  f93229b9
22 Aug, 2019 1 commit
- Add flags to run BERT with MultiWorkerMirroredStrategy. · 39aea35f
  Ayush Dubey authored Aug 22, 2019
```
PiperOrigin-RevId: 264935345
```
  39aea35f
07 Aug, 2019 1 commit

Merged commit includes the following changes: (#7404) · e38d570e

Hongkun Yu authored Aug 07, 2019

262178259  by hongkuny<hongkuny@google.com>:

    We should call training=True in CTL train step.

--
262081759  by akuegel<akuegel@google.com>:

    Internal change

PiperOrigin-RevId: 262178259

e38d570e

01 Aug, 2019 1 commit

Merged commit includes the following changes: (#7357) · aee49bbd

Hongkun Yu authored Aug 01, 2019

261202754  by hongkuny<hongkuny@google.com>:

    Use enable_xla flag for classifier and squad, so xla option is exposed to users.

--

PiperOrigin-RevId: 261202754

aee49bbd

26 Jul, 2019 1 commit

Merged commit includes the following changes: (#7309) · 8c7a0e75

Hongkun Yu authored Jul 26, 2019

260060237  by zongweiz<zongweiz@google.com>:

    [BERT SQuAD] Enable mixed precision training

    Add mixed precision training support for BERT SQuAD model. Using the experimental Keras mixed precision API. For numeric stability, use fp32 for layer normalization, dense layers with GELU activation, etc.

--

PiperOrigin-RevId: 260060237

8c7a0e75

02 Jul, 2019 1 commit

Merged commit includes the following changes: (#7141) · 5175b7e6

saberkun authored Jul 02, 2019

256204636  by hongkuny<hongkuny@google.com>:

    Internal

--
256079834  by hongkuny<hongkuny@google.com>:

    Clean up: move common flags together for further refactoring
    Enable steps_per_loop option for all applications.

--

PiperOrigin-RevId: 256204636

5175b7e6