1. 16 Nov, 2021 1 commit
  2. 13 Jul, 2021 2 commits
    • Jekaterina Jaroslavceva's avatar
      Global model training (#9904) · c9967b10
      Jekaterina Jaroslavceva authored
      * Dataset utilities added.
      
      * Global model definition
      
      * Dataset modules added.
      
      * Dataset modules fix.
      
      * global features model training added
      
      * global features fix
      
      * Test dataset update
      
      * PR fixes
      
      * repo sync
      
      * repo sync
      
      * Syncing 2
      
      * Syncing 2
      
      * Global model definition added
      
      * Global model definition added, synced
      
      * Adding global model dataset related modules
      
      * Global model training
      
      * tensorboard module added
      
      * linting issues fixed
      
      * linting fixes.
      
      * linting fixes.
      
      * Fix for previous PR
      
      * PR fixes
      
      * Minor fixes
      
      * Minor fixes
      
      * Dataset download fix
      
      * Comments fix
      
      * sfm120k fix
      
      * sfm120k fix
      
      * names fix
      
      * Update
      
      * Update
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Fixes
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      c9967b10
    • Jekaterina Jaroslavceva's avatar
      Global model (#9902) · 23837ecf
      Jekaterina Jaroslavceva authored
      * Dataset utilities added.
      
      * Global model definition
      
      * Dataset modules added.
      
      * Dataset modules fix.
      
      * global features model training added
      
      * global features fix
      
      * Test dataset update
      
      * PR fixes
      
      * repo sync
      
      * repo sync
      
      * Syncing 2
      
      * Syncing 2
      
      * Global model definition added
      
      * Global model definition added, synced
      
      * Adding global model dataset related modules
      
      * Global model training
      
      * tensorboard module added
      
      * linting issues fixed
      
      * linting fixes.
      
      * linting fixes.
      
      * Fix for previous PR
      
      * PR fixes
      
      * Minor fixes
      
      * Minor fixes
      
      * Dataset download fix
      
      * Comments fix
      
      * sfm120k fix
      
      * sfm120k fix
      
      * names fix
      
      * Update
      
      * Update
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * PR fixes global model
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      23837ecf
  3. 07 Jul, 2021 1 commit
    • Jekaterina Jaroslavceva's avatar
      Dataset modules (#9903) · fa038f86
      Jekaterina Jaroslavceva authored
      * Dataset utilities added.
      
      * Global model definition
      
      * Dataset modules added.
      
      * Dataset modules fix.
      
      * global features model training added
      
      * global features fix
      
      * Test dataset update
      
      * PR fixes
      
      * repo sync
      
      * repo sync
      
      * Syncing 2
      
      * Syncing 2
      
      * Global model definition added
      
      * Global model definition added, synced
      
      * Adding global model dataset related modules
      
      * Global model training
      
      * tensorboard module added
      
      * linting issues fixed
      
      * linting fixes.
      
      * linting fixes.
      
      * Fix for previous PR
      
      * PR fixes
      
      * Minor fixes
      
      * Minor fixes
      
      * Dataset download fix
      
      * Comments fix
      
      * sfm120k fix
      
      * sfm120k fix
      
      * names fix
      
      * Update
      
      * Update
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * PR fixes
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      
      * Merge branch 'global_model_training'
      
      # Conflicts:
      #	research/delf/delf/python/datasets/generic_dataset.py
      #	research/delf/delf/python/datasets/generic_dataset_test.py
      #	research/delf/delf/python/datasets/sfm120k/__init__.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k.py
      #	research/delf/delf/python/datasets/sfm120k/sfm120k_test.py
      #	research/delf/delf/python/datasets/tuples_dataset.py
      #	research/delf/delf/python/datasets/tuples_dataset_test.py
      #	research/delf/delf/python/training/global_features/__init__.py
      #	research/delf/delf/python/training/global_features/train.py
      #	research/delf/delf/python/training/model/global_model.py
      #	research/delf/delf/python/training/model/global_model_test.py
      #	research/delf/delf/python/training/tensorboard_utils.py
      fa038f86
  4. 09 Jun, 2021 2 commits
    • Arjun Karpur's avatar
      Merged commit includes the following changes: (#10058) · 927e31aa
      Arjun Karpur authored
      
      
      378492389  by Andre Araujo:
      
          Internal change
      
      --
      369671840  by Andre Araujo:
      
          Cleanup after recent PRs in DELF github repo.
      
      --
      360692342  by Andre Araujo:
      
          Replace direct TF app import with absl::app.
          (1) TF::app is deprecated
          (2) direct TF import is discouraged. go/gpylint-faq#g-direct-tensorflow-import
      
      --
      359157762  by Andre Araujo:
      
          Internal change
      
      --
      
      PiperOrigin-RevId: 378492389
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      927e31aa
    • Daniel Ron's avatar
      Fix attention application in DELG (#9906) · 7ff3ebcc
      Daniel Ron authored
      * Fix attention application in DELG
      
      * Adding DELG unit tests
      
      * Formatting for review
      
      * Formatting for review
      
      * Formatting for review
      7ff3ebcc
  5. 23 Apr, 2021 1 commit
    • André Araujo's avatar
      DELF codebase general cleanup (#9930) · 8a0f2272
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          ...
      8a0f2272
  6. 16 Apr, 2021 1 commit
    • Jekaterina Jaroslavceva's avatar
      Global model supporting functions (#9901) · 79946a70
      Jekaterina Jaroslavceva authored
      * Dataset utilities added.
      
      * Global model definition
      
      * Dataset modules added.
      
      * Dataset modules fix.
      
      * global features model training added
      
      * global features fix
      
      * Test dataset update
      
      * PR fixes
      
      * repo sync
      
      * repo sync
      
      * Syncing 2
      
      * Syncing 2
      
      * Added global model supporting modules
      
      * code style fixes
      
      * Minor style fixes
      79946a70
  7. 13 Apr, 2021 1 commit
    • Jekaterina Jaroslavceva's avatar
      File movings (#9899) · 3dacd474
      Jekaterina Jaroslavceva authored
      * Dataset utilities added.
      
      * Global model definition
      
      * Dataset modules added.
      
      * Dataset modules fix.
      
      * global features model training added
      
      * global features fix
      
      * Test dataset update
      
      * PR fixes
      
      * repo sync
      
      * repo sync
      
      * modules moving
      
      * Removed unnecessary modules
      
      * Removed unnecessary files
      3dacd474
  8. 19 Mar, 2021 1 commit
  9. 24 Feb, 2021 1 commit
    • André Araujo's avatar
      #delf Small formatting/convention changes after PR #9727 (#9748) · f104b965
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      
      * Update to DELF README, install instructions
      
      * Centralizing installation instructions
      
      * Small readme update
      
      * Fixing commas
      
      * Mention DELG acceptance into ECCV'20
      
      * Merged commit includes the following changes:
      326723075  by Andre Araujo:
      
          Move image resize utility into utils.py.
      
      --
      
      PiperOrigin-RevId: 326723075
      
      * Adding back matched_images_demo.png
      
      * Merged commit includes the following changes:
      327279047  by Andre Araujo:
      
          Adapt extractor to handle new form of joint local+global extraction.
      
      --
      326733524  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 327279047
      
      * Updated DELG instructions after model extraction refactoring
      
      * Updating GLDv2 paper model baseline
      
      * Merged commit includes the following changes:
      328982978  by Andre Araujo:
      
          Updated DELG model training so that the size of the output tensor is unchanged by the GeM pooling layer. Export global model trained with DELG global features.
      
      --
      328218938  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 328982978
      
      * Updated training README after recent changes
      
      * Updated training README to fix small typo
      
      * Merged commit includes the following changes:
      330022709  by Andre Araujo:
      
          Export joint local+global TF2 DELG model, and enable such joint extraction.
      
          Also, rename export_model.py -> export_local_model.py for better clarity.
      
          To check that the new exporting code is doing the right thing, I compared features extracted from the new exported model against those extracted from models exported with a single modality, using the same checkpoint. They are identical.
      
          Some other small changes:
          - small automatic reformating
          - small documentation improvements
      
      --
      
      PiperOrigin-RevId: 330022709
      
      * Updated DELG exporting instructions
      
      * Updated DELG exporting instructions: fix small typo
      
      * Adding DELG pre-trained models on GLDv2-clean
      
      * Merged commit includes the following changes:
      331625297  by Andre Araujo:
      
          Internal change.
      
      --
      330062115  by Andre Araujo:
      
          Fix small (non-critical) typo in the DELG extractor.
      
      --
      
      PiperOrigin-RevId: 331625297
      
      * Merged commit includes the following changes:
      347479009  by Andre Araujo:
      
          Fix image size setting for GLD training.
      
      --
      
      PiperOrigin-RevId: 347479009
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/copybara_25C283E7A3474256A7C206FC5ABF7E8D_0/google3/..
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/copybara_25C283E7A3474256A7C206FC5ABF7E8D_0/google3/..
      f104b965
  10. 12 Feb, 2021 1 commit
  11. 12 Jan, 2021 1 commit
    • Dan Anghel's avatar
      README update for DELF training with autoencoder (#9607) · 04af8d35
      Dan Anghel authored
      
      
      * Merged commit includes the following changes:
      326369548  by Andre Araujo:
      
          Fix import issues.
      
      --
      326159826  by Andre Araujo:
      
          Changed the implementation of the cosine weights from Keras layer to tf.Variable to manually control for L2 normalization.
      
      --
      326139082  by Andre Araujo:
      
          Support local feature matching using ratio test.
      
          To allow for easily choosing which matching type to use, we rename a flag/argument and modify all related files to avoid breakages.
      
          Also include a small change when computing nearest neighbors for geometric matching, to parallelize computation, which saves a little bit of time during execution (argument "n_jobs=-1").
      
      --
      326119848  by Andre Araujo:
      
          Option to measure DELG latency taking binarization into account.
      
      --
      324316608  by Andre Araujo:
      
          DELG global features training.
      
      --
      323693131  by Andre Araujo:
      
          PY3 conversion for delf public lib.
      
      --
      321046157  by Andre Araujo:
      
          Purely Google refactor
      
      --
      
      PiperOrigin-RevId: 326369548
      
      * Added export of delg_model module.
      
      * README update to explain training DELG global features head
      
      * Added guidelines for DELF hyperparameter values
      
      * Fixed typo
      
      * Added mention about remaining training flags.
      
      * Merged commit includes the following changes:
      334723489  by Andre Araujo:
      
          Backpropagate global and attention layers together.
      
      --
      334228310  by Andre Araujo:
      
          Enable scaling of local feature locations to the resized resolution.
      
      --
      
      PiperOrigin-RevId: 334723489
      
      * Merged commit includes the following changes:
      347032253  by Andre Araujo:
      
          Updated local and global_and_local model export scripts for exporting models trained with the autoencoder layer.
      
      --
      344312455  by Andre Araujo:
      
          Implement autoencoder in training pipeline.
      
      --
      341116593  by Andre Araujo:
      
          Reduce the default save_interval, to get more frequent checkpoints.
      
      --
      341111808  by Andre Araujo:
      
          Allow checkpoint restoration in DELF training, to enable resuming of training jobs.
      
      --
      340138315  by Andre Araujo:
      
          DELF training script: make it always save the last checkpoint.
      
      --
      338731551  by Andre Araujo:
      
          Add image_size flag in DELF/G OSS training script.
      
      --
      338684879  by Andre Araujo:
      
          Clean up summaries in DELF/G training script.
      
          - Previously, the call to tf.summary.record_if() was not working, which led to summaries being recorded at every step, leading to too large events files. This is fixed.
          - Previously, some summaries were computed at iteration k, while others at iteration k+1. Now, we standardize summary computations to always run after backpropagation (which means that summaries are reported for step k+1, referring to the batch k).
          - Added a new summary: number of global steps per second; useful to see how fast training is making progress.
      
          Also a few other small modifications are included:
          - Improved description of the train.py script.
          - Some small automatic reformattings.
      
      --
      
      PiperOrigin-RevId: 347032253
      
      * Updated README for training with autoencoder
      
      * DELF README update after first review.
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      04af8d35
  12. 16 Dec, 2020 1 commit
    • André Araujo's avatar
      Fix DELF image size loading for GLD (#9561) · f1789115
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      
      * Update to DELF README, install instructions
      
      * Centralizing installation instructions
      
      * Small readme update
      
      * Fixing commas
      
      * Mention DELG acceptance into ECCV'20
      
      * Merged commit includes the following changes:
      326723075  by Andre Araujo:
      
          Move image resize utility into utils.py.
      
      --
      
      PiperOrigin-RevId: 326723075
      
      * Adding back matched_images_demo.png
      
      * Merged commit includes the following changes:
      327279047  by Andre Araujo:
      
          Adapt extractor to handle new form of joint local+global extraction.
      
      --
      326733524  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 327279047
      
      * Updated DELG instructions after model extraction refactoring
      
      * Updating GLDv2 paper model baseline
      
      * Merged commit includes the following changes:
      328982978  by Andre Araujo:
      
          Updated DELG model training so that the size of the output tensor is unchanged by the GeM pooling layer. Export global model trained with DELG global features.
      
      --
      328218938  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 328982978
      
      * Updated training README after recent changes
      
      * Updated training README to fix small typo
      
      * Merged commit includes the following changes:
      330022709  by Andre Araujo:
      
          Export joint local+global TF2 DELG model, and enable such joint extraction.
      
          Also, rename export_model.py -> export_local_model.py for better clarity.
      
          To check that the new exporting code is doing the right thing, I compared features extracted from the new exported model against those extracted from models exported with a single modality, using the same checkpoint. They are identical.
      
          Some other small changes:
          - small automatic reformating
          - small documentation improvements
      
      --
      
      PiperOrigin-RevId: 330022709
      
      * Updated DELG exporting instructions
      
      * Updated DELG exporting instructions: fix small typo
      
      * Adding DELG pre-trained models on GLDv2-clean
      
      * Merged commit includes the following changes:
      331625297  by Andre Araujo:
      
          Internal change.
      
      --
      330062115  by Andre Araujo:
      
          Fix small (non-critical) typo in the DELG extractor.
      
      --
      
      PiperOrigin-RevId: 331625297
      
      * Merged commit includes the following changes:
      347479009  by Andre Araujo:
      
          Fix image size setting for GLD training.
      
      --
      
      PiperOrigin-RevId: 347479009
      f1789115
  13. 14 Dec, 2020 1 commit
    • Dan Anghel's avatar
      Autoencoder in the DELG model (#9555) · 4b8f7d47
      Dan Anghel authored
      
      
      * Merged commit includes the following changes:
      326369548  by Andre Araujo:
      
          Fix import issues.
      
      --
      326159826  by Andre Araujo:
      
          Changed the implementation of the cosine weights from Keras layer to tf.Variable to manually control for L2 normalization.
      
      --
      326139082  by Andre Araujo:
      
          Support local feature matching using ratio test.
      
          To allow for easily choosing which matching type to use, we rename a flag/argument and modify all related files to avoid breakages.
      
          Also include a small change when computing nearest neighbors for geometric matching, to parallelize computation, which saves a little bit of time during execution (argument "n_jobs=-1").
      
      --
      326119848  by Andre Araujo:
      
          Option to measure DELG latency taking binarization into account.
      
      --
      324316608  by Andre Araujo:
      
          DELG global features training.
      
      --
      323693131  by Andre Araujo:
      
          PY3 conversion for delf public lib.
      
      --
      321046157  by Andre Araujo:
      
          Purely Google refactor
      
      --
      
      PiperOrigin-RevId: 326369548
      
      * Added export of delg_model module.
      
      * README update to explain training DELG global features head
      
      * Added guidelines for DELF hyperparameter values
      
      * Fixed typo
      
      * Added mention about remaining training flags.
      
      * Merged commit includes the following changes:
      334723489  by Andre Araujo:
      
          Backpropagate global and attention layers together.
      
      --
      334228310  by Andre Araujo:
      
          Enable scaling of local feature locations to the resized resolution.
      
      --
      
      PiperOrigin-RevId: 334723489
      
      * Merged commit includes the following changes:
      347032253  by Andre Araujo:
      
          Updated local and global_and_local model export scripts for exporting models trained with the autoencoder layer.
      
      --
      344312455  by Andre Araujo:
      
          Implement autoencoder in training pipeline.
      
      --
      341116593  by Andre Araujo:
      
          Reduce the default save_interval, to get more frequent checkpoints.
      
      --
      341111808  by Andre Araujo:
      
          Allow checkpoint restoration in DELF training, to enable resuming of training jobs.
      
      --
      340138315  by Andre Araujo:
      
          DELF training script: make it always save the last checkpoint.
      
      --
      338731551  by Andre Araujo:
      
          Add image_size flag in DELF/G OSS training script.
      
      --
      338684879  by Andre Araujo:
      
          Clean up summaries in DELF/G training script.
      
          - Previously, the call to tf.summary.record_if() was not working, which led to summaries being recorded at every step, leading to too large events files. This is fixed.
          - Previously, some summaries were computed at iteration k, while others at iteration k+1. Now, we standardize summary computations to always run after backpropagation (which means that summaries are reported for step k+1, referring to the batch k).
          - Added a new summary: number of global steps per second; useful to see how fast training is making progress.
      
          Also a few other small modifications are included:
          - Improved description of the train.py script.
          - Some small automatic reformattings.
      
      --
      
      PiperOrigin-RevId: 347032253
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      4b8f7d47
  14. 06 Oct, 2020 1 commit
    • Dan Anghel's avatar
      Backpropagate global and attention layers together (#9335) · 85f52928
      Dan Anghel authored
      * Merged commit includes the following changes:
      326369548  by Andre Araujo:
      
          Fix import issues.
      
      --
      326159826  by Andre Araujo:
      
          Changed the implementation of the cosine weights from Keras layer to tf.Variable to manually control for L2 normalization.
      
      --
      326139082  by Andre Araujo:
      
          Support local feature matching using ratio test.
      
          To allow for easily choosing which matching type to use, we rename a flag/argument and modify all related files to avoid breakages.
      
          Also include a small change when computing nearest neighbors for geometric matching, to parallelize computation, which saves a little bit of time during execution (argument "n_jobs=-1").
      
      --
      326119848  by Andre Araujo:
      
          Option to measure DELG latency taking binarization into account.
      
      --
      324316608  by Andre Araujo:
      
          DELG global features training.
      
      --
      323693131  by Andre Araujo:
      
          PY3 conversion for delf public lib.
      
      --
      3210...
      85f52928
  15. 16 Sep, 2020 1 commit
    • André Araujo's avatar
      DELG: fix small typo on extractor.py (#9252) · c99f4e3a
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      
      * Update to DELF README, install instructions
      
      * Centralizing installation instructions
      
      * Small readme update
      
      * Fixing commas
      
      * Mention DELG acceptance into ECCV'20
      
      * Merged commit includes the following changes:
      326723075  by Andre Araujo:
      
          Move image resize utility into utils.py.
      
      --
      
      PiperOrigin-RevId: 326723075
      
      * Adding back matched_images_demo.png
      
      * Merged commit includes the following changes:
      327279047  by Andre Araujo:
      
          Adapt extractor to handle new form of joint local+global extraction.
      
      --
      326733524  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 327279047
      
      * Updated DELG instructions after model extraction refactoring
      
      * Updating GLDv2 paper model baseline
      
      * Merged commit includes the following changes:
      328982978  by Andre Araujo:
      
          Updated DELG model training so that the size of the output tensor is unchanged by the GeM pooling layer. Export global model trained with DELG global features.
      
      --
      328218938  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 328982978
      
      * Updated training README after recent changes
      
      * Updated training README to fix small typo
      
      * Merged commit includes the following changes:
      330022709  by Andre Araujo:
      
          Export joint local+global TF2 DELG model, and enable such joint extraction.
      
          Also, rename export_model.py -> export_local_model.py for better clarity.
      
          To check that the new exporting code is doing the right thing, I compared features extracted from the new exported model against those extracted from models exported with a single modality, using the same checkpoint. They are identical.
      
          Some other small changes:
          - small automatic reformating
          - small documentation improvements
      
      --
      
      PiperOrigin-RevId: 330022709
      
      * Updated DELG exporting instructions
      
      * Updated DELG exporting instructions: fix small typo
      
      * Adding DELG pre-trained models on GLDv2-clean
      
      * Merged commit includes the following changes:
      331625297  by Andre Araujo:
      
          Internal change.
      
      --
      330062115  by Andre Araujo:
      
          Fix small (non-critical) typo in the DELG extractor.
      
      --
      
      PiperOrigin-RevId: 331625297
      c99f4e3a
  16. 15 Sep, 2020 1 commit
    • André Araujo's avatar
      DELG: adding models pre-trained on GLDv2-clean (#9246) · 50cc55f8
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      
      * Update to DELF README, install instructions
      
      * Centralizing installation instructions
      
      * Small readme update
      
      * Fixing commas
      
      * Mention DELG acceptance into ECCV'20
      
      * Merged commit includes the following changes:
      326723075  by Andre Araujo:
      
          Move image resize utility into utils.py.
      
      --
      
      PiperOrigin-RevId: 326723075
      
      * Adding back matched_images_demo.png
      
      * Merged commit includes the following changes:
      327279047  by Andre Araujo:
      
          Adapt extractor to handle new form of joint local+global extraction.
      
      --
      326733524  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 327279047
      
      * Updated DELG instructions after model extraction refactoring
      
      * Updating GLDv2 paper model baseline
      
      * Merged commit includes the following changes:
      328982978  by Andre Araujo:
      
          Updated DELG model training so that the size of the output tensor is unchanged by the GeM pooling layer. Export global model trained with DELG global features.
      
      --
      328218938  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 328982978
      
      * Updated training README after recent changes
      
      * Updated training README to fix small typo
      
      * Merged commit includes the following changes:
      330022709  by Andre Araujo:
      
          Export joint local+global TF2 DELG model, and enable such joint extraction.
      
          Also, rename export_model.py -> export_local_model.py for better clarity.
      
          To check that the new exporting code is doing the right thing, I compared features extracted from the new exported model against those extracted from models exported with a single modality, using the same checkpoint. They are identical.
      
          Some other small changes:
          - small automatic reformating
          - small documentation improvements
      
      --
      
      PiperOrigin-RevId: 330022709
      
      * Updated DELG exporting instructions
      
      * Updated DELG exporting instructions: fix small typo
      
      * Adding DELG pre-trained models on GLDv2-clean
      50cc55f8
  17. 10 Sep, 2020 1 commit
    • Dan Anghel's avatar
      Added hyperparameter guidelines for DELF training (#9219) · 3a18c6ab
      Dan Anghel authored
      
      
      * Merged commit includes the following changes:
      326369548  by Andre Araujo:
      
          Fix import issues.
      
      --
      326159826  by Andre Araujo:
      
          Changed the implementation of the cosine weights from Keras layer to tf.Variable to manually control for L2 normalization.
      
      --
      326139082  by Andre Araujo:
      
          Support local feature matching using ratio test.
      
          To allow for easily choosing which matching type to use, we rename a flag/argument and modify all related files to avoid breakages.
      
          Also include a small change when computing nearest neighbors for geometric matching, to parallelize computation, which saves a little bit of time during execution (argument "n_jobs=-1").
      
      --
      326119848  by Andre Araujo:
      
          Option to measure DELG latency taking binarization into account.
      
      --
      324316608  by Andre Araujo:
      
          DELG global features training.
      
      --
      323693131  by Andre Araujo:
      
          PY3 conversion for delf public lib.
      
      --
      321046157  by Andre Araujo:
      
          Purely Google refactor
      
      --
      
      PiperOrigin-RevId: 326369548
      
      * Added export of delg_model module.
      
      * README update to explain training DELG global features head
      
      * Added guidelines for DELF hyperparameter values
      
      * Fixed typo
      
      * Added mention about remaining training flags.
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      3a18c6ab
  18. 04 Sep, 2020 1 commit
    • André Araujo's avatar
      Exporting option for DELG local+global feature model (#9198) · a9fcda17
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      
      * Update to DELF README, install instructions
      
      * Centralizing installation instructions
      
      * Small readme update
      
      * Fixing commas
      
      * Mention DELG acceptance into ECCV'20
      
      * Merged commit includes the following changes:
      326723075  by Andre Araujo:
      
          Move image resize utility into utils.py.
      
      --
      
      PiperOrigin-RevId: 326723075
      
      * Adding back matched_images_demo.png
      
      * Merged commit includes the following changes:
      327279047  by Andre Araujo:
      
          Adapt extractor to handle new form of joint local+global extraction.
      
      --
      326733524  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 327279047
      
      * Updated DELG instructions after model extraction refactoring
      
      * Updating GLDv2 paper model baseline
      
      * Merged commit includes the following changes:
      328982978  by Andre Araujo:
      
          Updated DELG model training so that the size of the output tensor is unchanged by the GeM pooling layer. Export global model trained with DELG global features.
      
      --
      328218938  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 328982978
      
      * Updated training README after recent changes
      
      * Updated training README to fix small typo
      
      * Merged commit includes the following changes:
      330022709  by Andre Araujo:
      
          Export joint local+global TF2 DELG model, and enable such joint extraction.
      
          Also, rename export_model.py -> export_local_model.py for better clarity.
      
          To check that the new exporting code is doing the right thing, I compared features extracted from the new exported model against those extracted from models exported with a single modality, using the same checkpoint. They are identical.
      
          Some other small changes:
          - small automatic reformating
          - small documentation improvements
      
      --
      
      PiperOrigin-RevId: 330022709
      
      * Updated DELG exporting instructions
      
      * Updated DELG exporting instructions: fix small typo
      a9fcda17
  19. 03 Sep, 2020 1 commit
    • André Araujo's avatar
      Exporting code for DELG global feature (#9191) · 81e4a36c
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      
      * Update to DELF README, install instructions
      
      * Centralizing installation instructions
      
      * Small readme update
      
      * Fixing commas
      
      * Mention DELG acceptance into ECCV'20
      
      * Merged commit includes the following changes:
      326723075  by Andre Araujo:
      
          Move image resize utility into utils.py.
      
      --
      
      PiperOrigin-RevId: 326723075
      
      * Adding back matched_images_demo.png
      
      * Merged commit includes the following changes:
      327279047  by Andre Araujo:
      
          Adapt extractor to handle new form of joint local+global extraction.
      
      --
      326733524  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 327279047
      
      * Updated DELG instructions after model extraction refactoring
      
      * Updating GLDv2 paper model baseline
      
      * Merged commit includes the following changes:
      328982978  by Andre Araujo:
      
          Updated DELG model training so that the size of the output tensor is unchanged by the GeM pooling layer. Export global model trained with DELG global features.
      
      --
      328218938  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 328982978
      
      * Updated training README after recent changes
      
      * Updated training README to fix small typo
      81e4a36c
  20. 25 Aug, 2020 1 commit
    • André Araujo's avatar
      Refactor DELG extraction + Release latest DELG paper models (#9145) · 6f9a8f19
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      
      * Update to DELF README, install instructions
      
      * Centralizing installation instructions
      
      * Small readme update
      
      * Fixing commas
      
      * Mention DELG acceptance into ECCV'20
      
      * Merged commit includes the following changes:
      326723075  by Andre Araujo:
      
          Move image resize utility into utils.py.
      
      --
      
      PiperOrigin-RevId: 326723075
      
      * Adding back matched_images_demo.png
      
      * Merged commit includes the following changes:
      327279047  by Andre Araujo:
      
          Adapt extractor to handle new form of joint local+global extraction.
      
      --
      326733524  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 327279047
      
      * Updated DELG instructions after model extraction refactoring
      
      * Updating GLDv2 paper model baseline
      6f9a8f19
  21. 18 Aug, 2020 1 commit
    • Dan Anghel's avatar
      README update for DELG training (#9112) · c4e7d734
      Dan Anghel authored
      
      
      * Merged commit includes the following changes:
      326369548  by Andre Araujo:
      
          Fix import issues.
      
      --
      326159826  by Andre Araujo:
      
          Changed the implementation of the cosine weights from Keras layer to tf.Variable to manually control for L2 normalization.
      
      --
      326139082  by Andre Araujo:
      
          Support local feature matching using ratio test.
      
          To allow for easily choosing which matching type to use, we rename a flag/argument and modify all related files to avoid breakages.
      
          Also include a small change when computing nearest neighbors for geometric matching, to parallelize computation, which saves a little bit of time during execution (argument "n_jobs=-1").
      
      --
      326119848  by Andre Araujo:
      
          Option to measure DELG latency taking binarization into account.
      
      --
      324316608  by Andre Araujo:
      
          DELG global features training.
      
      --
      323693131  by Andre Araujo:
      
          PY3 conversion for delf public lib.
      
      --
      321046157  by Andre Araujo:
      
          Purely Google refactor
      
      --
      
      PiperOrigin-RevId: 326369548
      
      * Added export of delg_model module.
      
      * README update to explain training DELG global features head
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      c4e7d734
  22. 14 Aug, 2020 2 commits
    • André Araujo's avatar
      Move DELF resizing code into utils.py, which is more appropriate than extractor.py. (#9108) · bd9c6c4e
      André Araujo authored
      * Merged commit includes the following changes:
      326723075  by Andre Araujo:
      
          Move image resize utility into utils.py.
      
      --
      
      PiperOrigin-RevId: 326723075
      
      * Adding back matched_images_demo.png
      bd9c6c4e
    • Dan Anghel's avatar
      DELF updates (#9095) · a003b7c1
      Dan Anghel authored
      
      
      * Merged commit includes the following changes:
      326369548  by Andre Araujo:
      
          Fix import issues.
      
      --
      326159826  by Andre Araujo:
      
          Changed the implementation of the cosine weights from Keras layer to tf.Variable to manually control for L2 normalization.
      
      --
      326139082  by Andre Araujo:
      
          Support local feature matching using ratio test.
      
          To allow for easily choosing which matching type to use, we rename a flag/argument and modify all related files to avoid breakages.
      
          Also include a small change when computing nearest neighbors for geometric matching, to parallelize computation, which saves a little bit of time during execution (argument "n_jobs=-1").
      
      --
      326119848  by Andre Araujo:
      
          Option to measure DELG latency taking binarization into account.
      
      --
      324316608  by Andre Araujo:
      
          DELG global features training.
      
      --
      323693131  by Andre Araujo:
      
          PY3 conversion for delf public lib.
      
      --
      321046157  by Andre Araujo:
      
          Purely Google refactor
      
      --
      
      PiperOrigin-RevId: 326369548
      
      * Added export of delg_model module.
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      a003b7c1
  23. 06 Jul, 2020 1 commit
  24. 01 Jul, 2020 2 commits
    • André Araujo's avatar
      DELF documentation updates (#8767) · 8a19350e
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      
      * Update to DELF README, install instructions
      
      * Centralizing installation instructions
      
      * Small readme update
      
      * Fixing commas
      8a19350e
    • André Araujo's avatar
      TF2 version for global feature model exporting (#8760) · 30bac445
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      
      * Merged commit includes the following changes:
      319114828  by Andre Araujo:
      
          Upgrade global feature model exporting to TF2.
      
      --
      
      PiperOrigin-RevId: 319114828
      
      * Properly merging README
      
      * small edits to README
      
      * small edits to README
      
      * small edits to README
      
      * global feature exporting in training README
      30bac445
  25. 30 Jun, 2020 2 commits
    • Dan Anghel's avatar
      Update to the DELF training README (#8759) · 04c0409c
      Dan Anghel authored
      
      
      * First version of working script to download the GLDv2 dataset
      
      * First version of the DEFL package installation script
      
      * First working version of the DELF package installation script
      
      * Fixed feedback from PR review
      
      * Push to Github of changes to the TFRecord data generation script for DELF.
      
      * Merged commit includes the following changes:
      315363544  by Andre Araujo:
      
          Added the generation of TRAIN and VALIDATE splits from the train dataset.
      
      --
      314676530  by Andre Araujo:
      
          Updated script to download GLDv2 images for DELF training.
      
      --
      314101235  by Andre Araujo:
      
          Added newly created module 'utils' to the copybara script.
      
      --
      313677085  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - logging (replaced usage of tf.compat.v1.logging.info)
          - testing directories (replaced usage of tf.compat.v1.test.get_temp_dir())
          - feature/object extraction scripts (replaced usage of tf.compat.v1.train.string_input_producer and tf.compat.v1.train.start_queue_runners with PIL)
      
      --
      312770828  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315363544
      
      * First version of the updated README of the DELF training instructions
      
      * Added to the README the section describing the generation of the training data
      
      * Added warning about the TFRecord generation time
      
      * Updated the launch of the training
      
      * Minor README update
      
      * Integrated review feedback
      
      * Merged commit includes the following changes:
      315971979  by Andre Araujo:
      
          Performance optimization in generating the TRAIN and VALIDATION splits per label.
      
      --
      315578370  by Andre Araujo:
      
          Tiny fix to char limit in extractor.py.
      
      --
      315546242  by Andre Araujo:
      
          Script to measure DELG latency.
      
      --
      315545801  by Andre Araujo:
      
          Pre-load PCA parameters, if using them when extracting DELF/G features.
      
      --
      315450392  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - loading the models using  in extractor.py and detector.py using tf.saved_model.load
          - removed tf.compat.v1.Session for the extractor and detector model usage
      
      --
      315406342  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315971979
      
      * Merged commit includes the following changes:
      316538447  by Andre Araujo:
      
          Read the number of classes from the GLDv2 dataset metadata.
      
      --
      316416973  by Andre Araujo:
      
          Migration of DELF code to TF2:
          - removed tf.compat.v1.test.get_temp_dir() with FLAGS.test_tmpdir
          - removed delf_v1.py and its dependencies
          - removed tf.compat.v1, Session, Graph dependencies from feature_extractor.py, feature_aggregation_extractor.py and aggregation_extraction.py
      
      --
      
      PiperOrigin-RevId: 316538447
      
      * Removed reference to delf_v1
      
      * Merged commit includes the following changes:
      318168500  by Andre Araujo:
      
          Several small changes to DELF open-source training code:
          - Replace "make_dataset_iterator" call which was deprecated by a more recent suitable version.
          - Add image summary, allowing visualization of the augmented images during training
          - Normalize images before feeding them to the model
      
      --
      316888714  by Andre Araujo:
      
          - Removed unnecessary cast from feature_aggregation_extraction.py
          - Fixed clustering script
      
      --
      
      PiperOrigin-RevId: 318168500
      
      * Merged commit includes the following changes:
      318401984  by Andre Araujo:
      
          Add attention visualization to DELF training script.
      
      --
      
      PiperOrigin-RevId: 318401984
      
      * README update with training and model validation steps
      
      * Minor fixes to the DEFL training README
      
      * Integrated review feedback
      
      * Changed passing of boolean parameter to script
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      04c0409c
    • BasiaFusinska's avatar
      Merged commit includes the following changes: (#8753) · df89d3e0
      BasiaFusinska authored
      318938278  by Andre Araujo:
      
          Loading pretrained ImageNet weights to initialize the ResNet backbone. Changed the defaults of the batch size and initial learning rate to increase convergence on the GLDv2 dataset. Made the evaluation batch size dynamic depending on the global batch size.
      
      --
      318911740  by Andre Araujo:
      
          Introduced additional shuffling of the TRAIN and VALIDATION datasets to ensure label variance across batches.
      
      --
      318908335  by Andre Araujo:
      
          Export model migration to TF2.
      
      --
      318489123  by Andre Araujo:
      
          Model exporting script for global feature trained with DELF codebase.
          Additionally, makes a small change to replace back_prop=False in the tf.while_loop call (see deprecation notice in https://www.tensorflow.org/api_docs/python/tf/while_loop
      
      ).
      
      --
      318401984  by Andre Araujo:
      
          Add attention visualization to DELF training script.
      
      --
      318168500  by Andre Araujo:
      
          Several small changes to DELF open-source training code:
          - Replace "make_dataset_iterator" call which was deprecated by a more recent suitable version.
          - Add image summary, allowing visualization of the augmented images during training
          - Normalize images before feeding them to the model
      
      --
      316888714  by Andre Araujo:
      
          - Removed unnecessary cast from feature_aggregation_extraction.py
          - Fixed clustering script
      
      --
      
      PiperOrigin-RevId: 318938278
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      df89d3e0
  26. 16 Jun, 2020 1 commit
    • Dan Anghel's avatar
      Fix to DELF package (#8679) · cabb22cd
      Dan Anghel authored
      
      
      * First version of working script to download the GLDv2 dataset
      
      * First version of the DEFL package installation script
      
      * First working version of the DELF package installation script
      
      * Fixed feedback from PR review
      
      * Push to Github of changes to the TFRecord data generation script for DELF.
      
      * Merged commit includes the following changes:
      315363544  by Andre Araujo:
      
          Added the generation of TRAIN and VALIDATE splits from the train dataset.
      
      --
      314676530  by Andre Araujo:
      
          Updated script to download GLDv2 images for DELF training.
      
      --
      314101235  by Andre Araujo:
      
          Added newly created module 'utils' to the copybara script.
      
      --
      313677085  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - logging (replaced usage of tf.compat.v1.logging.info)
          - testing directories (replaced usage of tf.compat.v1.test.get_temp_dir())
          - feature/object extraction scripts (replaced usage of tf.compat.v1.train.string_input_producer and tf.compat.v1.train.start_queue_runners with PIL)
      
      --
      312770828  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315363544
      
      * First version of the updated README of the DELF training instructions
      
      * Added to the README the section describing the generation of the training data
      
      * Added warning about the TFRecord generation time
      
      * Updated the launch of the training
      
      * Minor README update
      
      * Integrated review feedback
      
      * Merged commit includes the following changes:
      315971979  by Andre Araujo:
      
          Performance optimization in generating the TRAIN and VALIDATION splits per label.
      
      --
      315578370  by Andre Araujo:
      
          Tiny fix to char limit in extractor.py.
      
      --
      315546242  by Andre Araujo:
      
          Script to measure DELG latency.
      
      --
      315545801  by Andre Araujo:
      
          Pre-load PCA parameters, if using them when extracting DELF/G features.
      
      --
      315450392  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - loading the models using  in extractor.py and detector.py using tf.saved_model.load
          - removed tf.compat.v1.Session for the extractor and detector model usage
      
      --
      315406342  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315971979
      
      * Merged commit includes the following changes:
      316538447  by Andre Araujo:
      
          Read the number of classes from the GLDv2 dataset metadata.
      
      --
      316416973  by Andre Araujo:
      
          Migration of DELF code to TF2:
          - removed tf.compat.v1.test.get_temp_dir() with FLAGS.test_tmpdir
          - removed delf_v1.py and its dependencies
          - removed tf.compat.v1, Session, Graph dependencies from feature_extractor.py, feature_aggregation_extractor.py and aggregation_extraction.py
      
      --
      
      PiperOrigin-RevId: 316538447
      
      * Removed reference to delf_v1
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      cabb22cd
  27. 15 Jun, 2020 1 commit
    • Dan Anghel's avatar
      Push to Github of TF2 changes to DELF package (#8678) · 48b6d1d1
      Dan Anghel authored
      
      
      * First version of working script to download the GLDv2 dataset
      
      * First version of the DEFL package installation script
      
      * First working version of the DELF package installation script
      
      * Fixed feedback from PR review
      
      * Push to Github of changes to the TFRecord data generation script for DELF.
      
      * Merged commit includes the following changes:
      315363544  by Andre Araujo:
      
          Added the generation of TRAIN and VALIDATE splits from the train dataset.
      
      --
      314676530  by Andre Araujo:
      
          Updated script to download GLDv2 images for DELF training.
      
      --
      314101235  by Andre Araujo:
      
          Added newly created module 'utils' to the copybara script.
      
      --
      313677085  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - logging (replaced usage of tf.compat.v1.logging.info)
          - testing directories (replaced usage of tf.compat.v1.test.get_temp_dir())
          - feature/object extraction scripts (replaced usage of tf.compat.v1.train.string_input_producer and tf.compat.v1.train.start_queue_runners with PIL)
      
      --
      312770828  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315363544
      
      * First version of the updated README of the DELF training instructions
      
      * Added to the README the section describing the generation of the training data
      
      * Added warning about the TFRecord generation time
      
      * Updated the launch of the training
      
      * Minor README update
      
      * Integrated review feedback
      
      * Merged commit includes the following changes:
      315971979  by Andre Araujo:
      
          Performance optimization in generating the TRAIN and VALIDATION splits per label.
      
      --
      315578370  by Andre Araujo:
      
          Tiny fix to char limit in extractor.py.
      
      --
      315546242  by Andre Araujo:
      
          Script to measure DELG latency.
      
      --
      315545801  by Andre Araujo:
      
          Pre-load PCA parameters, if using them when extracting DELF/G features.
      
      --
      315450392  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - loading the models using  in extractor.py and detector.py using tf.saved_model.load
          - removed tf.compat.v1.Session for the extractor and detector model usage
      
      --
      315406342  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315971979
      
      * Merged commit includes the following changes:
      316538447  by Andre Araujo:
      
          Read the number of classes from the GLDv2 dataset metadata.
      
      --
      316416973  by Andre Araujo:
      
          Migration of DELF code to TF2:
          - removed tf.compat.v1.test.get_temp_dir() with FLAGS.test_tmpdir
          - removed delf_v1.py and its dependencies
          - removed tf.compat.v1, Session, Graph dependencies from feature_extractor.py, feature_aggregation_extractor.py and aggregation_extraction.py
      
      --
      
      PiperOrigin-RevId: 316538447
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      48b6d1d1
  28. 12 Jun, 2020 2 commits
    • Dan Anghel's avatar
      Push to Github of changes to DELF package (#8670) · b3ef7ae9
      Dan Anghel authored
      
      
      * First version of working script to download the GLDv2 dataset
      
      * First version of the DEFL package installation script
      
      * First working version of the DELF package installation script
      
      * Fixed feedback from PR review
      
      * Push to Github of changes to the TFRecord data generation script for DELF.
      
      * Merged commit includes the following changes:
      315363544  by Andre Araujo:
      
          Added the generation of TRAIN and VALIDATE splits from the train dataset.
      
      --
      314676530  by Andre Araujo:
      
          Updated script to download GLDv2 images for DELF training.
      
      --
      314101235  by Andre Araujo:
      
          Added newly created module 'utils' to the copybara script.
      
      --
      313677085  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - logging (replaced usage of tf.compat.v1.logging.info)
          - testing directories (replaced usage of tf.compat.v1.test.get_temp_dir())
          - feature/object extraction scripts (replaced usage of tf.compat.v1.train.string_input_producer and tf.compat.v1.train.start_queue_runners with PIL)
      
      --
      312770828  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315363544
      
      * First version of the updated README of the DELF training instructions
      
      * Added to the README the section describing the generation of the training data
      
      * Added warning about the TFRecord generation time
      
      * Updated the launch of the training
      
      * Minor README update
      
      * Integrated review feedback
      
      * Merged commit includes the following changes:
      315971979  by Andre Araujo:
      
          Performance optimization in generating the TRAIN and VALIDATION splits per label.
      
      --
      315578370  by Andre Araujo:
      
          Tiny fix to char limit in extractor.py.
      
      --
      315546242  by Andre Araujo:
      
          Script to measure DELG latency.
      
      --
      315545801  by Andre Araujo:
      
          Pre-load PCA parameters, if using them when extracting DELF/G features.
      
      --
      315450392  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - loading the models using  in extractor.py and detector.py using tf.saved_model.load
          - removed tf.compat.v1.Session for the extractor and detector model usage
      
      --
      315406342  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315971979
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      b3ef7ae9
    • Dan Anghel's avatar
      DELF Training Documentation Update (#8663) · 41613994
      Dan Anghel authored
      
      
      * First version of working script to download the GLDv2 dataset
      
      * First version of the DEFL package installation script
      
      * First working version of the DELF package installation script
      
      * Fixed feedback from PR review
      
      * Push to Github of changes to the TFRecord data generation script for DELF.
      
      * Merged commit includes the following changes:
      315363544  by Andre Araujo:
      
          Added the generation of TRAIN and VALIDATE splits from the train dataset.
      
      --
      314676530  by Andre Araujo:
      
          Updated script to download GLDv2 images for DELF training.
      
      --
      314101235  by Andre Araujo:
      
          Added newly created module 'utils' to the copybara script.
      
      --
      313677085  by Andre Araujo:
      
          Code migration from TF1 to TF2 for:
          - logging (replaced usage of tf.compat.v1.logging.info)
          - testing directories (replaced usage of tf.compat.v1.test.get_temp_dir())
          - feature/object extraction scripts (replaced usage of tf.compat.v1.train.string_input_producer and tf.compat.v1.train.start_queue_runners with PIL)
      
      --
      312770828  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315363544
      
      * First version of the updated README of the DELF training instructions
      
      * Added to the README the section describing the generation of the training data
      
      * Added warning about the TFRecord generation time
      
      * Updated the launch of the training
      
      * Minor README update
      
      * Integrated review feedback
      Co-authored-by: default avatarAndre Araujo <andrearaujo@google.com>
      41613994
  29. 08 Jun, 2020 1 commit
    • Dan Anghel's avatar
      Push to Github of changes to the TFRecord generation of GLDv2 dataset (#8650) · e82a2d9f
      Dan Anghel authored
      * First version of working script to download the GLDv2 dataset
      
      * First version of the DEFL package installation script
      
      * First working version of the DELF package installation script
      
      * Fixed feedback from PR review
      
      * Push to Github of changes to the TFRecord data generation script for DELF.
      
      * Merged commit includes the following changes:
      315363544  
      
          Added the generation of TRAIN and VALIDATE splits from the train dataset.
      
      --
      314676530  
      
          Updated script to download GLDv2 images for DELF training.
      
      --
      314101235  
      
          Added newly created module 'utils' to the copybara script.
      
      --
      313677085  
      
          Code migration from TF1 to TF2 for:
          - logging (replaced usage of tf.compat.v1.logging.info)
          - testing directories (replaced usage of tf.compat.v1.test.get_temp_dir())
          - feature/object extraction scripts (replaced usage of tf.compat.v1.train.string_input_producer and tf.compat.v1.train.start_queue_runners with PIL)
      
      --
      312770828  by 
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 315363544
      e82a2d9f
  30. 04 Jun, 2020 1 commit
  31. 29 May, 2020 1 commit
  32. 22 May, 2020 2 commits
    • André Araujo's avatar
      Small documentation update (#8558) · 92287fe0
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      
      * Clarify that library must be installed before reproducing results
      92287fe0
    • André Araujo's avatar
      Add GLDv2 baseline in DELF codebase (#8557) · 979e296a
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      
      * Merged commit includes the following changes:
      312754894  by Andre Araujo:
      
          Code edits / instructions to reproduce GLDv2 results.
      
      --
      
      PiperOrigin-RevId: 312754894
      
      * Markdown updates after adding GLDv2 stuff
      
      * Small updates to DELF README
      979e296a
  33. 21 May, 2020 1 commit
    • André Araujo's avatar
      Add DELG code (#8553) · bc7c9810
      André Araujo authored
      * Merged commit includes the following changes:
      253126424  by Andre Araujo:
      
          Scripts to compute metrics for Google Landmarks dataset.
      
          Also, a small fix to metric in retrieval case: avoids duplicate predicted images.
      
      --
      253118971  by Andre Araujo:
      
          Metrics for Google Landmarks dataset.
      
      --
      253106953  by Andre Araujo:
      
          Library to read files from Google Landmarks challenges.
      
      --
      250700636  by Andre Araujo:
      
          Handle case of aggregation extraction with empty set of input features.
      
      --
      250516819  by Andre Araujo:
      
          Add minimum size for DELF extractor.
      
      --
      250435822  by Andre Araujo:
      
          Add max_image_size/min_image_size for open-source DELF proto / module.
      
      --
      250414606  by Andre Araujo:
      
          Refactor extract_aggregation to allow reuse with different datasets.
      
      --
      250356863  by Andre Araujo:
      
          Remove unnecessary cmd_args variable from boxes_and_features_extraction.
      
      --
      249783379  by Andre Araujo:
      
          Create directory for writing mapping file if it does not exist.
      
      --
      249581591  by Andre Araujo:
      
          Refactor scripts to extract boxes and features from images in Revisited datasets.
          Also, change tf.logging.info --> print for easier logging in open source code.
      
      --
      249511821  by Andre Araujo:
      
          Small change to function for file/directory handling.
      
      --
      249289499  by Andre Araujo:
      
          Internal change.
      
      --
      
      PiperOrigin-RevId: 253126424
      
      * Updating DELF init to adjust to latest changes
      
      * Editing init files for python packages
      
      * Edit D2R dataset reader to work with py3.
      
      PiperOrigin-RevId: 253135576
      
      * DELF package: fix import ordering
      
      * Adding new requirements to setup.py
      
      * Adding init file for training dir
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * Adding init file for training subdirs
      
      * Working version of DELF training
      
      * Internal change.
      
      PiperOrigin-RevId: 253248648
      
      * Fix variance loading in open-source code.
      
      PiperOrigin-RevId: 260619120
      
      * Separate image re-ranking as a standalone library, and add metric writing to dataset library.
      
      PiperOrigin-RevId: 260998608
      
      * Tool to read written D2R Revisited datasets metrics file. Test is added.
      
      Also adds a unit test for previously-existing SaveMetricsFile function.
      
      PiperOrigin-RevId: 263361410
      
      * Add optional resize factor for feature extraction.
      
      PiperOrigin-RevId: 264437080
      
      * Fix NumPy's new version spacing changes.
      
      PiperOrigin-RevId: 265127245
      
      * Maker image matching function visible, and add support for RANSAC seed.
      
      PiperOrigin-RevId: 277177468
      
      * Avoid matplotlib failure due to missing display backend.
      
      PiperOrigin-RevId: 287316435
      
      * Removes tf.contrib dependency.
      
      PiperOrigin-RevId: 288842237
      
      * Fix tf contrib removal for feature_aggregation_extractor.
      
      PiperOrigin-RevId: 289487669
      
      * Merged commit includes the following changes:
      309118395  by Andre Araujo:
      
          Make DELF open-source code compatible with TF2.
      
      --
      309067582  by Andre Araujo:
      
          Handle image resizing rounding properly for python extraction.
      
          New behavior is tested with unit tests.
      
      --
      308690144  by Andre Araujo:
      
          Several changes to improve DELF model/training code and make it work in TF 2.1.0:
          - Rename some files for better clarity
          - Using compat.v1 versions of functions
          - Formatting changes
          - Using more appropriate TF function names
      
      --
      308689397  by Andre Araujo:
      
          Internal change.
      
      --
      308341315  by Andre Araujo:
      
          Remove old slim dependency in DELF open-source model.
      
          This avoids issues with requiring old TF-v1, making it compatible with latest TF.
      
      --
      306777559  by Andre Araujo:
      
          Internal change
      
      --
      304505811  by Andre Araujo:
      
          Raise error during geometric verification if local features have different dimensionalities.
      
      --
      301739992  by Andre Araujo:
      
          Transform some geometric verification constants into arguments, to allow custom matching.
      
      --
      301300324  by Andre Araujo:
      
          Apply name change(experimental_run_v2 -> run) for all callers in Tensorflow.
      
      --
      299919057  by Andre Araujo:
      
          Automated refactoring to make code Python 3 compatible.
      
      --
      297953698  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297521242  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297278247  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297270405  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297238741  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      297108605  by Andre Araujo:
      
          Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration
      
      --
      294676131  by Andre Araujo:
      
          Add option to resize images to square resolutions without aspect ratio preservation.
      
      --
      293849641  by Andre Araujo:
      
          Internal change.
      
      --
      293840896  by Andre Araujo:
      
          Changing Slim import to tf_slim codebase.
      
      --
      293661660  by Andre Araujo:
      
          Allow the delf training script to read from TFRecords dataset.
      
      --
      291755295  by Andre Araujo:
      
          Internal change.
      
      --
      291448508  by Andre Araujo:
      
          Internal change.
      
      --
      291414459  by Andre Araujo:
      
          Adding train script.
      
      --
      291384336  by Andre Araujo:
      
          Adding model export script and test.
      
      --
      291260565  by Andre Araujo:
      
          Adding placeholder for Google Landmarks dataset.
      
      --
      291205548  by Andre Araujo:
      
          Definition of DELF model using Keras ResNet50 as backbone.
      
      --
      289500793  by Andre Araujo:
      
          Add TFRecord building script for delf.
      
      --
      
      PiperOrigin-RevId: 309118395
      
      * Updating README, dependency versions
      
      * Updating training README
      
      * Fixing init import of export_model
      
      * Fixing init import of export_model_utils
      
      * tkinter in INSTALL_INSTRUCTIONS
      
      * Merged commit includes the following changes:
      
      FolderOrigin-RevId: /google/src/cloud/andrearaujo/delf_oss/google3/..
      
      * INSTALL_INSTRUCTIONS mentioning different cloning options
      
      * Updating required TF version, since 2.1 is not available in pip
      
      * Internal change.
      
      PiperOrigin-RevId: 309136003
      
      * Fix missing string_input_producer and start_queue_runners in TF2.
      
      PiperOrigin-RevId: 309437512
      
      * Handle RANSAC from skimage's latest versions.
      
      PiperOrigin-RevId: 310170897
      
      * DELF 2.1 version: badge and setup.py updated
      
      * Add TF version badge in INSTALL_INSTRUCTIONS and paper badges in README
      
      * Add paper badges in paper instructions
      
      * Add paper badge to landmark detection instructions
      
      * Small update to DELF training README
      
      * Merged commit includes the following changes:
      312614961  by Andre Araujo:
      
          Instructions/code to reproduce DELG paper results.
      
      --
      312523414  by Andre Araujo:
      
          Fix a minor bug when post-process extracted features, format config.delf_global_config.image_scales_ind to a list.
      
      --
      312340276  by Andre Araujo:
      
          Add support for global feature extraction in DELF open-source codebase.
      
      --
      311031367  by Andre Araujo:
      
          Add use_square_images as an option in DELF config. The default value is false. if it is set, then images are resized to square resolution before feature extraction (e.g. Starburst use case. ) Thought for a while, whether to have two constructor of DescriptorToImageTemplate, but in the end, decide to only keep one, may be less confusing.
      
      --
      310658638  by Andre Araujo:
      
          Option for producing local feature-based image match visualization.
      
      --
      
      PiperOrigin-RevId: 312614961
      
      * DELF README update / DELG instructions
      
      * DELF README update
      
      * DELG instructions update
      
      * Merged commit includes the following changes:
      
      PiperOrigin-RevId: 312695597
      bc7c9810