GitLab

PiperOrigin-RevId: 444154402

Clean up: move the legacy AdamW implementation to optimization/ and add a warning to guide users consider the choice in Keras package.

PiperOrigin-RevId: 440383490

PiperOrigin-RevId: 438823508

PiperOrigin-RevId: 437879827

PiperOrigin-RevId: 437870878

PiperOrigin-RevId: 437120060

PiperOrigin-RevId: 435102510

PiperOrigin-RevId: 428831391

PiperOrigin-RevId: 428599243

PiperOrigin-RevId: 424391275

PiperOrigin-RevId: 422612138

PiperOrigin-RevId: 418724903

PiperOrigin-RevId: 410629444

PiperOrigin-RevId: 410592289

PiperOrigin-RevId: 410294118

[Cleanup] Remove hyperparams/config_definitions.py. The classes are only for deprecated models. Move the usages to individual legacy models and we will remove them finally.

PiperOrigin-RevId: 408997960

PiperOrigin-RevId: 406973172

PiperOrigin-RevId: 405693354

PiperOrigin-RevId: 405537096

PiperOrigin-RevId: 403471439

PiperOrigin-RevId: 402689877

PiperOrigin-RevId: 398790392

PiperOrigin-RevId: 398612420

PiperOrigin-RevId: 397848064

PiperOrigin-RevId: 395980073

PiperOrigin-RevId: 393366505

PiperOrigin-RevId: 392499545

PiperOrigin-RevId: 390359654

PiperOrigin-RevId: 390025168

PiperOrigin-RevId: 389101303

PiperOrigin-RevId: 388865163

PiperOrigin-RevId: 388575593

PiperOrigin-RevId: 388322760

PiperOrigin-RevId: 388106758

PiperOrigin-RevId: 386654855

Before, it was too easy to accidentally forget to set runtime.loss_scale, which had to always be done if mixed precision is used, otherwise the model would converge to worse accuracy. Now, all that needs to be done to use mixed precision is to set runtime.mixed_precision_dtype=float16.

PiperOrigin-RevId: 383767033

PiperOrigin-RevId: 383066915

Added use_keras_upsampling_2d flags to use keras upsampling layer instead of optimized custom spatial_transform_ops.

PiperOrigin-RevId: 382626602

PiperOrigin-RevId: 382396878

PiperOrigin-RevId: 381302776