GitLab

PiperOrigin-RevId: 320240466

PiperOrigin-RevId: 320149378

Add a colab to introduce nlp/modeling library with examples showing how to build pretrain/span labeling/classification models.

PiperOrigin-RevId: 320147054

PiperOrigin-RevId: 320145633

PiperOrigin-RevId: 320144607

PiperOrigin-RevId: 320124801

PiperOrigin-RevId: 320040329

PiperOrigin-RevId: 319864953

PiperOrigin-RevId: 319839860

PiperOrigin-RevId: 319744469

PiperOrigin-RevId: 319697990

PiperOrigin-RevId: 319557230

PiperOrigin-RevId: 319495967

PiperOrigin-RevId: 319475767

PiperOrigin-RevId: 319282071

PiperOrigin-RevId: 319276332

PiperOrigin-RevId: 319267378

supportted --> supported

319125512  by aom:

    Internal change

--
319108395  by rathodv:

    Internal Change

--
319106259  by ronnyvotel:

    Updating input pipeline to return DensePose labels.

--

PiperOrigin-RevId: 319125512
Co-authored-by: Zhichao Lu <lzc@google.com>

PiperOrigin-RevId: 319162455

PiperOrigin-RevId: 319162455

Add SpineNet to the Announcements section

PiperOrigin-RevId: 319157806

PiperOrigin-RevId: 319157806

* Merged commit includes the following changes:
253126424  by Andre Araujo:

    Scripts to compute metrics for Google Landmarks dataset.

    Also, a small fix to metric in retrieval case: avoids duplicate predicted images.

--
253118971  by Andre Araujo:

    Metrics for Google Landmarks dataset.

--
253106953  by Andre Araujo:

    Library to read files from Google Landmarks challenges.

--
250700636  by Andre Araujo:

    Handle case of aggregation extraction with empty set of input features.

--
250516819  by Andre Araujo:

    Add minimum size for DELF extractor.

--
250435822  by Andre Araujo:

    Add max_image_size/min_image_size for open-source DELF proto / module.

--
250414606  by Andre Araujo:

    Refactor extract_aggregation to allow reuse with different datasets.

--
250356863  by Andre Araujo:

    Remove unnecessary cmd_args variable from boxes_and_features_extraction.

--
249783379  by Andr...

* First version of working script to download the GLDv2 dataset

* First version of the DEFL package installation script

* First working version of the DELF package installation script

* Fixed feedback from PR review

* Push to Github of changes to the TFRecord data generation script for DELF.

* Merged commit includes the following changes:
315363544  by Andre Araujo:

    Added the generation of TRAIN and VALIDATE splits from the train dataset.

--
314676530  by Andre Araujo:

    Updated script to download GLDv2 images for DELF training.

--
314101235  by Andre Araujo:

    Added newly created module 'utils' to the copybara script.

--
313677085  by Andre Araujo:

    Code migration from TF1 to TF2 for:
    - logging (replaced usage of tf.compat.v1.logging.info)
    - testing directories (replaced usage of tf.compat.v1.test.get_temp_dir())
    - feature/object extraction scripts (replaced usage of tf.compat.v1.train.string_input_producer and tf.compat.v1.train.start_queue_runners with PIL)

--
312770828  by Andre Araujo:

    Internal change.

--

PiperOrigin-RevId: 315363544

* First version of the updated README of the DELF training instructions

* Added to the README the section describing the generation of the training data

* Added warning about the TFRecord generation time

* Updated the launch of the training

* Minor README update

* Integrated review feedback

* Merged commit includes the following changes:
315971979  by Andre Araujo:

    Performance optimization in generating the TRAIN and VALIDATION splits per label.

--
315578370  by Andre Araujo:

    Tiny fix to char limit in extractor.py.

--
315546242  by Andre Araujo:

    Script to measure DELG latency.

--
315545801  by Andre Araujo:

    Pre-load PCA parameters, if using them when extracting DELF/G features.

--
315450392  by Andre Araujo:

    Code migration from TF1 to TF2 for:
    - loading the models using  in extractor.py and detector.py using tf.saved_model.load
    - removed tf.compat.v1.Session for the extractor and detector model usage

--
315406342  by Andre Araujo:

    Internal change.

--

PiperOrigin-RevId: 315971979

* Merged commit includes the following changes:
316538447  by Andre Araujo:

    Read the number of classes from the GLDv2 dataset metadata.

--
316416973  by Andre Araujo:

    Migration of DELF code to TF2:
    - removed tf.compat.v1.test.get_temp_dir() with FLAGS.test_tmpdir
    - removed delf_v1.py and its dependencies
    - removed tf.compat.v1, Session, Graph dependencies from feature_extractor.py, feature_aggregation_extractor.py and aggregation_extraction.py

--

PiperOrigin-RevId: 316538447

* Removed reference to delf_v1

* Merged commit includes the following changes:
318168500  by Andre Araujo:

    Several small changes to DELF open-source training code:
    - Replace "make_dataset_iterator" call which was deprecated by a more recent suitable version.
    - Add image summary, allowing visualization of the augmented images during training
    - Normalize images before feeding them to the model

--
316888714  by Andre Araujo:

    - Removed unnecessary cast from feature_aggregation_extraction.py
    - Fixed clustering script

--

PiperOrigin-RevId: 318168500

* Merged commit includes the following changes:
318401984  by Andre Araujo:

    Add attention visualization to DELF training script.

--

PiperOrigin-RevId: 318401984

* README update with training and model validation steps

* Minor fixes to the DEFL training README

* Integrated review feedback

* Changed passing of boolean parameter to script
Co-authored-by: Andre Araujo <andrearaujo@google.com>

PiperOrigin-RevId: 319114361

PiperOrigin-RevId: 319114361

* Initial commit for faster rcnn resnet v1 fpn feature extractor.

1. Setup code structure for fpn feature extractor

* draft for faster rcnn resnet vi fpn feature extractor

* draft for faster rcnn resnet v1 fpn feature extractor

* add seperated class for resnet 50 101 152

* draft for get_box_classifier_feature_extractor_model

* remove unused code

* Init test file for faster_rcnn_fpn_keras_feature extractor

* add unit test for get_proposal_feature_extractor_model

* add unit test for get_proposal_feature_extractor_model smaller input size

* add unit test for get_proposal_feature_extractor_model incorrect dimension

* change keras model output format

* Update size on extract_proposal_features tests

* change default fpn_min_level to 2

* fix error in get_box_classifier_feature_extractor_model

* add shape test for get_box_classifier_feature_extractor_model

* fix coding style

* Fix coding style for feature extractor.

* add faster rcnn resnet v1 fpn feature extractor to model builder

* rename fpn feature extractors

* modify doc string for Feature extractor:

drop word "implementation"

* add todo in get_box_classifier_feature_extractor_model

* remove enable_v2_behavior

* drop unittest test_extract_proposal_features_dies_with_incorrect_rank_inputs

* modify feature extractor name

* remove min_depth and depth_multiplier feature

* Add coarse layers for faster rcnn fpn keras model

1. Add coarse layers
2. Update corresponding unit test to check the size of the coarse layer
is correct

* change the default max_fpn_level to 6

* change unittest since default max_fpn_level is change to 6

Contributed by mickeystroller

PiperOrigin-RevId: 319073522

Contributed by mickeystroller

PiperOrigin-RevId: 319073522

319052168  by rathodv:

    Change assertAllEqual to assertAllClose for Position Sensitive Crop and Resize to avoid flaky tests.

--
319044492  by rathodv:

    Internal change.

--
319039033  by ronnyvotel:

    Preprocessor ops for DensePose.

--
319035440  by sbeery:

    External beam code with DataFlow Support

--
318899436  by ronnyvotel:

    DensePose library for common operations like scaling, coordinate transformations, and flipping.

--
318833308  by Vivek Rathod:

      Internal Change

--

PiperOrigin-RevId: 319052168

PiperOrigin-RevId: 319058156

PiperOrigin-RevId: 319058156

318938278  by Andre Araujo:

    Loading pretrained ImageNet weights to initialize the ResNet backbone. Changed the defaults of the batch size and initial learning rate to increase convergence on the GLDv2 dataset. Made the evaluation batch size dynamic depending on the global batch size.

--
318911740  by Andre Araujo:

    Introduced additional shuffling of the TRAIN and VALIDATION datasets to ensure label variance across batches.

--
318908335  by Andre Araujo:

    Export model migration to TF2.

--
318489123  by Andre Araujo:

    Model exporting script for global feature trained with DELF codebase.
    Additionally, makes a small change to replace back_prop=False in the tf.while_loop call (see deprecation notice in https://www.tensorflow.org/api_docs/python/tf/while_loop

).

--
318401984  by Andre Araujo:

    Add attention visualization to DELF training script.

--
318168500  by Andre Araujo:

    Several small changes to DELF open-source training code:
    - Replace "make_dataset_iterator" call which was deprecated by a more recent suitable version.
    - Add image summary, allowing visualization of the augmented images during training
    - Normalize images before feeding them to the model

--
316888714  by Andre Araujo:

    - Removed unnecessary cast from feature_aggregation_extraction.py
    - Fixed clustering script

--

PiperOrigin-RevId: 318938278
Co-authored-by: Andre Araujo <andrearaujo@google.com>

PiperOrigin-RevId: 318945656

PiperOrigin-RevId: 318945656

PiperOrigin-RevId: 318945656

PiperOrigin-RevId: 318942343

PiperOrigin-RevId: 318942343