1. 23 Jul, 2024 1 commit
  2. 22 Jul, 2024 2 commits
  3. 19 Jul, 2024 5 commits
  4. 18 Jul, 2024 2 commits
    • Raushan Turganbay's avatar
      Chameleon: minor fixes after shipping (#32037) · 673d30b8
      Raushan Turganbay authored
      * fix merging
      
      * make chameleon conditional
      673d30b8
    • Pavel Iakubovskii's avatar
      Add `sdpa` and FA2 for CLIP (#31940) · 1c37e8c1
      Pavel Iakubovskii authored
      
      
      * Squashed commit of the following:
      
      commit 102842cd477219b9f9bcb23a0bca3a8b92bd732f
      Author: Pavel Iakubovskii <qubvel@gmail.com>
      Date:   Fri Jul 12 18:23:52 2024 +0000
      
          Add model-specific sdpa tests
      
      commit 60e4c88581abf89ec098da84ed8e92aa904c997d
      Author: Pavel Iakubovskii <qubvel@gmail.com>
      Date:   Fri Jul 12 18:20:53 2024 +0000
      
          Add fallback to eager (expensive operation)
      
      commit c29033d30e7ffde4327e8a15cbbc6bee37546f80
      Author: Pavel Iakubovskii <qubvel@gmail.com>
      Date:   Thu Jul 11 17:09:55 2024 +0000
      
          Fix attn_implementation propagation
      
      commit 783aed05f0f38cb2f99e758f81db6838ac55b9f8
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 09:05:27 2024 +0530
      
          style
      
      commit e77e703ca75d00447cda277eca6b886cd32bddc0
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 09:04:57 2024 +0530
      
          add comment to explain why I had to touch forbidden codebase.
      
      commit ab9d8849758e7773a31778ccba71588d18552623
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 09:03:02 2024 +0530
      
          fix: flax attribute access.
      
      commit c570fc0abf9d1bd58c291aae3c7e384f995996d2
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 08:23:54 2024 +0530
      
          fix tensorflow attribute name.
      
      commit 32c812871cfdb268d8a6e3e2c61c5c925c8ed47e
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 07:57:10 2024 +0530
      
          fix attribute access.
      
      commit 4f41a0138b6c417aed9c9332278f8bcd979cb7c2
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 07:44:02 2024 +0530
      
          _from_config.
      
      commit 35aed64ff602422adcf41d7f677a0a24bd9eccae
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 24 18:46:52 2024 +0530
      
          propagation of attn_implementation.
      
      commit 4c25c19845438b1dc1d35a5adf9436151c8c5940
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 24 09:24:36 2024 +0530
      
          style again
      
      commit 5f7dc5c5015c0f8116408f737e8c318d1802c80c
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 24 09:19:05 2024 +0530
      
          use from_config.
      
      commit b70c409956d0359fa6ae5372275d2a20ba7e3389
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 24 09:13:43 2024 +0530
      
          quality
      
      commit a7b63beff53d0fc754c6564e2a7b51731ddee49d
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 14:35:10 2024 +0200
      
          add benchmark numbers
      
      commit 455b0eaea50862b8458c8f422b60fe60ae40fdcb
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 13:50:16 2024 +0200
      
          Revert "reflect feedback more"
      
          This reverts commit dc123e71eff60aae74d5f325f113d515d0d71117.
      
      commit ca674829d28787349c2a9593a14e0f1d41f04ea4
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 13:50:05 2024 +0200
      
          Revert "fix"
      
          This reverts commit 37a1cb35b87acdc4cf7528b8b1ed6da27d244e52.
      
      commit fab2dd8576c099eb1a3464958cb206a664d28247
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 13:47:46 2024 +0200
      
          fix
      
      commit fbc6ae50fd6f2d36294d31e191761631b701d696
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 13:38:30 2024 +0200
      
          reflect feedback more
      
      commit 87245bb020b2d60a89afe318a951df0159404fc9
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 08:54:34 2024 +0530
      
          fixes
      
      commit 1057cc26390ee839251e7f8b3326c4207595fb23
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 07:49:03 2024 +0530
      
          don't explicit set attn_implementation in tests
      
      commit e33f75916fc8a99f516b1cf449dbbe9d3aabda81
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 07:43:54 2024 +0530
      
          explicitly override attn_implementation in the towers.
      
      commit 4cf41cb1bc885c39df7cb8f2a0694ebf23299235
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 07:38:42 2024 +0530
      
          import in one-line.
      
      commit f2cc447ae9e74ccfacb448140cdf88259d4afc8c
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 07:34:58 2024 +0530
      
          move sdpa mention to usage tips.
      
      commit 92884766c64dbb456926a3a84dd427be1349fa95
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Mon Apr 29 10:58:26 2024 +0530
      
          fix: memory allocation problem.
      
      commit d7ffbbfe12f7750b7d0a361420f35c13e0ea787d
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Mon Apr 29 09:56:59 2024 +0530
      
          fix-copies
      
      commit 8dfc3731cedd02e36acd3fe56bb2e6d61efd25d8
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri Apr 26 20:16:12 2024 +0530
      
          address arthur's comments.
      
      commit d2ed7b4ce4ff15ae9aa4d3d0500f1544e3dcd9e9
      Author: Sayak Paul <spsayakpaul@gmail.com>
      Date:   Fri Apr 26 20:08:15 2024 +0530
      
          Apply suggestions from code review
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      commit 46e04361f37ded5c522ff05e9f725b9f82dce40e
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Wed Apr 24 09:55:27 2024 +0530
      
          add to docs.
      
      commit 831629158ad40d34d8983f209afb2740ba041af2
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Wed Apr 24 09:33:10 2024 +0530
      
          styling.g
      
      commit d263a119c77314250f4b4c8469caf42559197f22
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Wed Apr 24 09:15:20 2024 +0530
      
          up
      
      commit d44f9d3d7633d4c241a737a1bc317f791f6aedb3
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Tue Apr 23 18:40:42 2024 +0530
      
          handle causal and attention mask
      
      commit 122f1d60153df6666b634a94e38d073f3f260926
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Tue Apr 23 15:18:21 2024 +0530
      
          test fixes.
      
      commit 4382d8cff6fa1dee5dbcf0d06b3e2841231e36f5
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Tue Apr 23 09:39:25 2024 +0530
      
          fix: scaling inside sdpa.
      
      commit 0f629989efc48b7315cf19405a81e02955efe7e5
      Author: Sayak Paul <spsayakpaul@gmail.com>
      Date:   Tue Apr 23 08:14:58 2024 +0530
      
          Update src/transformers/models/clip/modeling_clip.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      commit 14367316877dc27ea40f767ad1aee38bbc97e4ce
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Mon Apr 22 16:21:36 2024 +0530
      
          add: sdpa support to clip.
      
      * Remove fallback for empty attention mask (expensive operation)
      
      * Fix typing in copies
      
      * Add flash attention
      
      * Add flash attention tests
      
      * List CLIP in FA docs
      
      * Fix embeddings attributes and tf
      
      * [run-slow] clip
      
      * Update clip documentation
      
      * Remove commented code, skip compile dynamic for CLIPModel
      
      * Fix doc
      
      * Fix doc 2
      
      * Remove double transpose
      
      * Add torch version check for contiguous()
      
      * Add comment to test mixin
      
      * Fix copies
      
      * Add comment for mask
      
      * Update docs
      
      * [run-slow] clip
      1c37e8c1
  5. 17 Jul, 2024 1 commit
  6. 11 Jul, 2024 1 commit
    • Naman Garg's avatar
      Adding hiera (#30356) · c1e139c2
      Naman Garg authored
      
      
      * initialized Structure
      
      * Updated variable names
      
      * Added Config class, basic HF setup, convert_to_hf
      
      * Fixed Convert function, added hiera to HF files, Initilized test files
      
      * better naming for x in forward pass
      
      * Moved utils to hiera
      
      * Change hiera -> hiera_model
      
      * Fixed integration into tranformers
      
      * Fix: Convert Checkpoint
      
      * added documentation for hiera
      
      * added documentation for hiera
      
      * added Docstings to models, Transformers based changes
      
      * make style and quality
      
      * make style and quality
      
      * Integration & Block tests running
      
      * Fixed bugs
      
      * initialized Structure
      
      * Updated variable names
      
      * Added Config class, basic HF setup, convert_to_hf
      
      * Fixed Convert function, added hiera to HF files, Initilized test files
      
      * better naming for x in forward pass
      
      * Moved utils to hiera
      
      * Change hiera -> hiera_model
      
      * Fixed integration into tranformers
      
      * Fix: Convert Checkpoint
      
      * added documentation for hiera
      
      * added documentation for hiera
      
      * added Docstings to models, Transformers based changes
      
      * make style and quality
      
      * make style and quality
      
      * Integration & Block tests running
      
      * Fixed bugs
      
      * Removed tim dependency
      
      * added HieraBlock
      
      * fixed: Model name
      
      * added tests for HieraModel, HieraBlock
      
      * fixed imports
      
      * fixed quality & copies
      
      * Fixes
      
      * Update docs/source/en/model_doc/hiera.md
      
      Fix name
      Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      
      * Update docs/source/en/model_doc/hiera.md
      Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      
      * Update docs/source/en/model_doc/hiera.md
      Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      
      * Update src/transformers/models/hiera/configuration_hiera.py
      Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      
      * Update src/transformers/models/hiera/configuration_hiera.py
      Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      
      * Update src/transformers/models/hiera/modeling_hiera.py
      Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      
      * Update src/transformers/models/hiera/modeling_hiera.py
      Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      
      * Fixed formatting
      
      * Code quality & Import differences
      
      * quality and repo-consistency fix
      
      * fixed no torch error
      
      * Docstring fix
      
      * Docstring fix
      
      * doc string fix
      
      * fixed example usage
      
      * Resolved issues in modeling_hiera
      
      * Removed Hiera MAE
      
      * Added test and resolved bug
      
      * fixed doc string
      
      * First commit
      
      * Finished conversion script and model forward working
      
      * Resolved all issues
      
      * nits
      
      * Improving tests
      
      * Nits
      
      * More nits
      
      * Improving HieraForMaskedImageModeling
      
      * More improvements and nits
      
      * Fixed docstrings of outputs
      
      * More fixes
      
      * More imrpovments
      
      * Updated conversion script
      
      * Fixed docstrings
      
      * Improved tests
      
      * Fixed attentou outputs test
      
      * All tests green
      
      * Removed unnecessary file
      
      * contribution attribution
      
      * Resolved a few issues
      
      * Resolved Comments
      
      * Updated model repo id and fixed bugs
      
      * Removed loss print
      
      * Make tests green
      
      * Updated docstrings
      
      * Fix style
      
      * Fixed num_heads in config
      
      * Removed unnecessary video checkpoint related code in the conversion script
      
      * Fix style
      
      * Changed atol in conversion script
      
      * HieraConfig
      
      * Fix copies
      
      * Fixed typo
      
      * Resolved few issues
      
      * make
      
      * converted conv_nd -> nn.Module
      
      * Removed video complexities
      
      * Removed video complexities
      
      * fix style
      
      * Addressing comments
      
      * Update src/transformers/models/hiera/modeling_hiera.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Update src/transformers/models/hiera/modeling_hiera.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Update src/transformers/models/hiera/modeling_hiera.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Fix style
      
      * Fixed tests
      
      * Fixed typo
      
      * Fixed interpolate test
      
      * Made torch fx compatible
      
      * Made sure imageprocesor is correct
      
      * Addressed comments
      
      * Noise directly as torch
      
      * Remove unnecesary attr
      
      * Added return_dit
      
      * Update src/transformers/models/hiera/__init__.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Updated checkpoints
      
      * [run_slow] hiera
      
      * Fixed device mismatch
      
      * [run_slow] hiera
      
      * Fixed GPU tests
      
      * [run_slow] hiera
      
      ---------
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-29-50.us-east-2.compute.internal>
      Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      Co-authored-by: default avatarEduardo Pacheco <eduardo.pach@hotmail.com>
      Co-authored-by: default avatarEduardo Pacheco <69953243+EduardoPach@users.noreply.github.com>
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      c1e139c2
  7. 10 Jul, 2024 2 commits
  8. 09 Jul, 2024 1 commit
  9. 08 Jul, 2024 2 commits
    • Pavel Iakubovskii's avatar
      Add FA2 and `sdpa` support for SigLIP (#31499) · a177821b
      Pavel Iakubovskii authored
      * Rebase to main
      
      * Fix attention implementation autoset for tex and vision configs
      
      * Fixup
      
      * Minor fixes
      
      * Fix copies
      
      * Fix attention_mask for FA2
      
      * Add eqvivalence tests for siglip
      
      * Remove right padding test
      
      * Uncomment flaky
      
      * Fix import
      
      * Add to docs
      
      * Fix test message
      
      * Add sdpa
      
      * Add sdpa equivalence test
      
      * Add siglip sdpa to docs
      
      * Fix typing for attention output
      
      * Add sdpa tests
      
      * Fix signature of FA2
      
      * Autoset attn_implementation in config
      
      * Rename bsz -> batch_size
      
      * Move back autoset attn method
      
      * Mark as flaky
      
      * Correct attention mask padding
      
      * [run-slow] siglip
      
      * Add FA2 and sdpa docs
      
      * Style fix
      
      * Remove flaky for FA2 test
      
      * Change attention implementation set
      
      * Change attn_implementaiton propogation
      
      * Fix typos
      
      * Add modality to assert message
      
      * Add more sdpa backends in test
      
      * [run slow] siglip
      
      * Add math sdpa backend for all options
      
      * [run slow] siglip
      a177821b
    • NielsRogge's avatar
      Add ZoeDepth (#30136) · 06fd7972
      NielsRogge authored
      
      
      * First draft
      
      * Add docs
      
      * Clean up code
      
      * Convert model
      
      * Add image processor
      
      * Convert Zoe_K
      
      * More improvements
      
      * Improve variable names and docstrings
      
      * Improve variable names
      
      * Improve variable names
      
      * Replace nn.sequential
      
      * More improvements
      
      * Convert ZoeD_NK
      
      * Fix most tests
      
      * Verify pixel values
      
      * Verify pixel values
      
      * Add squeeze
      
      * Update beit to support arbitrary window sizes
      
      * Improve image processor
      
      * Improve docstring
      
      * Improve beit
      
      * Improve model outputs
      
      * Add figure
      
      * Fix beit
      
      * Update checkpoint
      
      * Fix repo id
      
      * Add _keys_to_ignore_on_load_unexpected
      
      * More improvements
      
      * Address comments
      
      * Address comments
      
      * Address comments
      
      * Address comments
      
      * Rename variable name
      
      * Add backbone_hidden_size
      
      * Vectorize
      
      * Vectorize more
      
      * Address comments
      
      * Clarify docstring
      
      * Remove backbone_hidden_size
      
      * Fix image processor
      
      * Remove print statements
      
      * Remove print statement
      
      * Add integration test
      
      * Address comments
      
      * Address comments
      
      * Address comments
      
      * Address comments
      
      * Add requires_backends
      
      * Clean up
      
      * Simplify conversion script
      
      * Simplify more
      
      * Simplify more
      
      * Simplify more
      
      * Clean up
      
      * Make sure beit is loaded correctly
      
      * Address comment
      
      * Address bin_configurations
      
      * Use bin_configurations
      
      * Convert models, add integration tests
      
      * Fix doc test
      
      * Address comments
      
      * Unify regressor classes
      
      * Clarify arguments
      
      * Improve resize_image
      
      * Add num_relative_features
      
      * Address comment
      
      * [run-slow]beit,data2vec,zoedepth
      
      * [run-slow]beit,data2vec,zoedepth
      
      * Address comments
      
      * Address comment
      
      * Address comment
      
      * Replace nn.TransformerEncoderLayer and nn.TransformerEncoder
      
      * Replace nn.MultiheadAttention
      
      * Add attributes for patch transformer to config
      
      * Add tests for ensure_multiple_of
      
      * Update organization
      
      * Add tests
      
      * [run-slow] beit data2vec
      
      * Update ruff
      
      * [run-slow] beit data2vec
      
      * Add comment
      
      * Improve docstrings, add test
      
      * Fix interpolate_pos_encoding
      
      * Fix slow tests
      
      * Add docstring
      
      * Update src/transformers/models/zoedepth/image_processing_zoedepth.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Update src/transformers/models/zoedepth/image_processing_zoedepth.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Improve tests and docstrings
      
      * Use run_common_tests
      
      * Improve docstrings
      
      * Improve docstrings
      
      * Improve tests
      
      * Improve tests
      
      * Remove print statements
      
      ---------
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      06fd7972
  10. 05 Jul, 2024 2 commits
    • Pedro Cuenca's avatar
      Depth Anything: update conversion script for V2 (#31522) · 1082361a
      Pedro Cuenca authored
      * Depth Anything: update conversion script for V2
      
      * Update docs
      
      * Style
      
      * Revert "Update docs"
      
      This reverts commit be0ca47ea1be4f3cd9aa2113bdd8efcc9959119e.
      
      * Add docs for depth anything v2
      
      * Add depth_anything_v2 to MODEL_NAMES_MAPPING
      
      Done similarly to Flan-T5: https://github.com/huggingface/transformers/pull/19892/files
      
      * Add tip in original docs
      1082361a
    • Billy Cao's avatar
      Add training support for SigLIP (#31495) · 1d3eaa6f
      Billy Cao authored
      * Add siglip loss function
      
      * Update docs
      
      * Enable training tests
      [experimental] enable GC training tests as it has worked for my own data
      
      * Remove test_training* overrides to enable training tests
      [run_slow] siglip
      
      * Skip training tests for Siglip text model and ImageClassificationModel
      [run_slow] siglip
      
      * Skip GC training tests for SiglipForImageClassification
      
      * Explicitly skip training tests for SiglipVisionModel
      Add skip reason for training tests for SiglipTextModel
      
      * Remove copied from to fix CI
      1d3eaa6f
  11. 02 Jul, 2024 2 commits
  12. 27 Jun, 2024 2 commits
  13. 26 Jun, 2024 3 commits
    • Raushan Turganbay's avatar
      Add LLaVa NeXT Video (#31252) · e71f2863
      Raushan Turganbay authored
      
      
      * squash into single commit
      
      * run diff once more
      
      * docstring
      
      * tests
      
      * minor chnages and ready to go
      
      * Update src/transformers/models/llava_next_video/processing_llava_next_video.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Update tests/models/vipllava/test_modeling_vipllava.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * [run-slow] llava-next-video
      
      * [run-slow] llava-next-video
      
      * [run-slow] llava_next_video
      
      * fix two tests
      
      * fix slow tests
      
      * remove logit checks due to numeric errors
      
      * run test once more
      
      * [run-slow] llava_next_video
      
      * final try to pass the test
      
      * [run-slow] llava_next_video
      
      * [run-slow] llava_next_video
      
      * [run-slow] llava_next_video
      
      * style
      
      * fix
      
      * style
      
      ---------
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      e71f2863
    • Pavel Iakubovskii's avatar
      Update RT-DETR code snippet (#31631) · ac52084b
      Pavel Iakubovskii authored
      Update code snippet
      ac52084b
    • Anton Vlasjuk's avatar
      [`GPT-NeoX`] Add SDPA support (#31031) · b07770c5
      Anton Vlasjuk authored
      * starting support for sdpa in `gptneox` models
      
      * small comment on tests
      
      * fix dropout
      
      * documentation and style
      
      * clarify concrete paths for reference
      
      * generalise attn projections and rope application
      
      added head mask check to sdpa mask creation
      
      handle sdpa memory backend bug via own version flag
      
      * update docs and style
      
      * move dtype casting outside of general attn_projection_and_rope function
      
      fix flash_attn_2 stuff
      
      * more generic attn warning if output_attns or head_mask
      
      * simplify head mask check by moving head mask creation to a later point
      
      * remove copied llama artifact
      
      * remove padding_mask from attention function signature
      
      * removing unnecessary comments, only "save" attn implementation once
      
      * [run_slow] gpt_neox
      b07770c5
  14. 25 Jun, 2024 1 commit
    • Raushan Turganbay's avatar
      Add video modality for InstrucBLIP (#30182) · fc689d75
      Raushan Turganbay authored
      * squash in single commit
      
      * add docs
      
      * dummy obj
      
      * more changes in diff converter
      
      * tiny fix
      
      * make docs happy
      
      * skip test
      
      * repo consistency tests
      
      * update docstring
      
      * style
      
      * fix tests
      
      * change diff imports
      
      * [run-slow] instructblipvideo
      
      * [run-slow] instructblipvideo
      
      * fix tests and remove logit check
      
      * [run-slow] instructblipvideo
      fc689d75
  15. 21 Jun, 2024 1 commit
  16. 19 Jun, 2024 2 commits
  17. 11 Jun, 2024 1 commit
    • amyeroberts's avatar
      Fast image processor (#28847) · f53fe35b
      amyeroberts authored
      
      
      * Draft fast image processors
      
      * Draft working fast version
      
      * py3.8 compatible cache
      
      * Enable loading fast image processors through auto
      
      * Tidy up; rescale behaviour based on input type
      
      * Enable tests for fast image processors
      
      * Smarter rescaling
      
      * Don't default to Fast
      
      * Safer imports
      
      * Add necessary Pillow requirement
      
      * Woops
      
      * Add AutoImageProcessor test
      
      * Fix up
      
      * Fix test for imagegpt
      
      * Fix test
      
      * Review comments
      
      * Add warning for TF and JAX input types
      
      * Rearrange
      
      * Return transforms
      
      * NumpyToTensor transformation
      
      * Rebase - include changes from upstream in ImageProcessingMixin
      
      * Safe typing
      
      * Fix up
      
      * convert mean/std to tesnor to rescale
      
      * Don't store transforms in state
      
      * Fix up
      
      * Update src/transformers/image_processing_utils_fast.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * Update src/transformers/models/auto/image_processing_auto.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * Update src/transformers/models/auto/image_processing_auto.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * Update src/transformers/models/auto/image_processing_auto.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * Warn if fast image processor available
      
      * Update src/transformers/models/vit/image_processing_vit_fast.py
      
      * Transpose incoming numpy images to be in CHW format
      
      * Update mapping names based on packages, auto set fast to None
      
      * Fix up
      
      * Fix
      
      * Add AutoImageProcessor.from_pretrained(checkpoint, use_fast=True) test
      
      * Update src/transformers/models/vit/image_processing_vit_fast.py
      Co-authored-by: default avatarPavel Iakubovskii <qubvel@gmail.com>
      
      * Add equivalence and speed tests
      
      * Fix up
      
      ---------
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      Co-authored-by: default avatarPavel Iakubovskii <qubvel@gmail.com>
      f53fe35b
  18. 10 Jun, 2024 1 commit
    • Pavel Iakubovskii's avatar
      Decorators for deprecation and named arguments validation (#30799) · 517df566
      Pavel Iakubovskii authored
      
      
      * Fix do_reduce_labels for maskformer image processor
      
      * Deprecate reduce_labels in favor to do_reduce_labels
      
      * Deprecate reduce_labels in favor to do_reduce_labels (segformer)
      
      * Deprecate reduce_labels in favor to do_reduce_labels (oneformer)
      
      * Deprecate reduce_labels in favor to do_reduce_labels (maskformer)
      
      * Deprecate reduce_labels in favor to do_reduce_labels (mask2former)
      
      * Fix typo
      
      * Update mask2former test
      
      * fixup
      
      * Update segmentation examples
      
      * Update docs
      
      * Fixup
      
      * Imports fixup
      
      * Add deprecation decorator draft
      
      * Add deprecation decorator
      
      * Fixup
      
      * Add deprecate_kwarg decorator
      
      * Validate kwargs decorator
      
      * Kwargs validation (beit)
      
      * fixup
      
      * Kwargs validation (mask2former)
      
      * Kwargs validation (maskformer)
      
      * Kwargs validation (oneformer)
      
      * Kwargs validation (segformer)
      
      * Better message
      
      * Fix oneformer processor save-load test
      
      * Update src/transformers/utils/deprecation.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Update src/transformers/utils/deprecation.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Update src/transformers/utils/deprecation.py
      Co-authored-by: default avatarPablo Montalvo <39954772+molbap@users.noreply.github.com>
      
      * Update src/transformers/utils/deprecation.py
      Co-authored-by: default avatarPablo Montalvo <39954772+molbap@users.noreply.github.com>
      
      * Better handle classmethod warning
      
      * Fix typo, remove warn
      
      * Add header
      
      * Docs and `additional_message`
      
      * Move to filter decorator ot generic
      
      * Proper deprecation for semantic segm scripts
      
      * Add to __init__ and update import
      
      * Basic tests for filter decorator
      
      * Fix doc
      
      * Override `to_dict()` to pop depracated `_max_size`
      
      * Pop unused parameters
      
      * Fix trailing whitespace
      
      * Add test for deprecation
      
      * Add deprecation warning control parameter
      
      * Update generic test
      
      * Fixup deprecation tests
      
      * Introduce init service kwargs
      
      * Revert popping unused params
      
      * Revert oneformer test
      
      * Allow "metadata" to pass
      
      * Better docs
      
      * Fix test
      
      * Add notion in docstring
      
      * Fix notification for both names
      
      * Add func name to warning message
      
      * Fixup
      
      ---------
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      Co-authored-by: default avatarPablo Montalvo <39954772+molbap@users.noreply.github.com>
      517df566
  19. 05 Jun, 2024 1 commit
  20. 04 Jun, 2024 1 commit
  21. 31 May, 2024 2 commits
  22. 28 May, 2024 2 commits
    • amyeroberts's avatar
      Deprecate low use models (#30781) · a564d10a
      amyeroberts authored
      * Deprecate models
      - graphormer
      - time_series_transformer
      - xlm_prophetnet
      - qdqbert
      - nat
      - ernie_m
      - tvlt
      - nezha
      - mega
      - jukebox
      - vit_hybrid
      - x_clip
      - deta
      - speech_to_text_2
      - efficientformer
      - realm
      - gptsan_japanese
      
      * Fix up
      
      * Fix speech2text2 imports
      
      * Make sure message isn't indented
      
      * Fix docstrings
      
      * Correctly map for deprecated models from model_type
      
      * Uncomment out
      
      * Add back time series transformer and x-clip
      
      * Import fix and fix-up
      
      * Fix up with updated ruff
      a564d10a
    • NielsRogge's avatar
      [SuperPoint, PaliGemma] Update docs (#31025) · 90da0b1c
      NielsRogge authored
      * Update docs
      
      * Add PaliGemma resources
      
      * Address comment
      
      * Update docs
      90da0b1c
  23. 27 May, 2024 1 commit
  24. 23 May, 2024 1 commit
    • Aritra Roy Gosthipaty's avatar
      [Port] TensorFlow implementation of Mistral (#29708) · 965e98dc
      Aritra Roy Gosthipaty authored
      
      
      * chore: initial commit
      
      * chore: adding imports and inits
      
      * chore: adding the causal and classification code
      
      * chore: adding names to the layers
      
      * chore: using single self attn layer
      
      * chore: built the model and layers
      
      * chore: start with testing
      
      * chore: docstring change, transpose fix
      
      * fix: rotary embedding
      
      * chore: adding cache implementation
      
      * remove unused torch
      
      * chore: fixing the indexing issue
      
      * make fix-copies
      
      * Use modeling_tf_utils.keras
      
      * make fixup
      
      * chore: fixing tests
      
      * chore: adding past key value logic
      
      * chore: adding multi label classfication test
      
      * fix: switching on the built parameters in the layers
      
      * fixing repo consistency
      
      * ruff formats
      
      * style changes
      
      * fix: tf and pt equivalence
      
      * removing returns from docstrings
      
      * fix docstrings
      
      * fix docstrings
      
      * removing todos
      
      * fix copies
      
      * fix docstring
      
      * fix docstring
      
      * chore: using easier rotate_half
      
      * adding integration tests
      
      * chore: addressing review related to rotary embedding layer
      
      * review changes
      
      * [run-slow] mistral
      
      * skip: test save load after resize token embedding
      
      * style
      
      ---------
      Co-authored-by: default avatarMatt <rocketknight1@gmail.com>
      965e98dc