1. 18 Jul, 2024 9 commits
    • Sai-Suraj-27's avatar
      docs: Fixed 2 links in the docs along with some minor fixes (#32058) · 271fd8e6
      Sai-Suraj-27 authored
      * Fixed 2 links in the docs along with some minor fixes.
      
      * Updated Contributing.md
      271fd8e6
    • Sai-Suraj-27's avatar
      fix: Removed `duplicate entries` in a dictionary (#32041) · 8f0d26c5
      Sai-Suraj-27 authored
      Removed duplicate key in a dictionary.
      8f0d26c5
    • Longjie Zheng's avatar
      Add torch.compile Support For Mamba (#31247) · c75969ee
      Longjie Zheng authored
      * modify mamba cache
      
      * set up cache
      
      * add test
      
      * [run-slow] mamba
      
      * [run-slow] mamba
      
      * address comments
      
      * [run-slow] mamba
      
      * use_cache_position
      
      * [run-slow] mamba
      
      * [run-slow] mamba
      
      * [run-slow] mamba
      
      * [run-slow] mamba
      
      * fix
      
      * cache in generate
      
      * [run-slow] mamba
      
      * address comments
      
      * [run-slow] mamba
      
      * [run-slow] mamba
      
      * address comments
      
      * [run-slow] mamba
      
      * fix
      
      * [run-slow] mamba
      
      * fix
      
      * [run-slow] mamba
      
      * fix cache name
      
      * [run-slow] mamba
      c75969ee
    • Joshua Lochner's avatar
      [mistral] Support passing `head_dim` through config (and do not require... · 4c040aba
      Joshua Lochner authored
      [mistral] Support passing `head_dim` through config (and do not require `head_dim * num_heads == hidden_size`) (#32050)
      
      * Allow `head_dim` to be set in Mistral config
      
      * Add docstring
      
      * Do not require `head_dim * num_heads == hidden_size`
      
      * [run-slow] mistral
      4c040aba
    • dependabot[bot]'s avatar
      Bump scikit-learn from 1.1.2 to 1.5.0 in /examples/research_projects/codeparrot/examples (#32052) · c50e0551
      dependabot[bot] authored
      Bump scikit-learn in /examples/research_projects/codeparrot/examples
      
      Bumps [scikit-learn](https://github.com/scikit-learn/scikit-learn) from 1.1.2 to 1.5.0.
      - [Release notes](https://github.com/scikit-learn/scikit-learn/releases)
      - [Commits](https://github.com/scikit-learn/scikit-learn/compare/1.1.2...1.5.0
      
      )
      
      ---
      updated-dependencies:
      - dependency-name: scikit-learn
        dependency-type: direct:production
      ...
      Signed-off-by: default avatardependabot[bot] <support@github.com>
      Co-authored-by: default avatardependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
      c50e0551
    • dependabot[bot]'s avatar
      Bump scikit-learn from 1.0.2 to 1.5.0 in /examples/research_projects/decision_transformer (#31458) · c25dde1f
      dependabot[bot] authored
      Bump scikit-learn in /examples/research_projects/decision_transformer
      
      Bumps [scikit-learn](https://github.com/scikit-learn/scikit-learn) from 1.0.2 to 1.5.0.
      - [Release notes](https://github.com/scikit-learn/scikit-learn/releases)
      - [Commits](https://github.com/scikit-learn/scikit-learn/compare/1.0.2...1.5.0
      
      )
      
      ---
      updated-dependencies:
      - dependency-name: scikit-learn
        dependency-type: direct:production
      ...
      Signed-off-by: default avatardependabot[bot] <support@github.com>
      Co-authored-by: default avatardependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
      c25dde1f
    • Raushan Turganbay's avatar
      Chameleon: minor fixes after shipping (#32037) · 673d30b8
      Raushan Turganbay authored
      * fix merging
      
      * make chameleon conditional
      673d30b8
    • Yih-Dar's avatar
      unpin `numpy<2.0` (#32018) · 765732e9
      Yih-Dar authored
      
      
      * unpin np
      
      * [test_all] trigger full CI
      
      ---------
      Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      765732e9
    • Pavel Iakubovskii's avatar
      Add `sdpa` and FA2 for CLIP (#31940) · 1c37e8c1
      Pavel Iakubovskii authored
      
      
      * Squashed commit of the following:
      
      commit 102842cd477219b9f9bcb23a0bca3a8b92bd732f
      Author: Pavel Iakubovskii <qubvel@gmail.com>
      Date:   Fri Jul 12 18:23:52 2024 +0000
      
          Add model-specific sdpa tests
      
      commit 60e4c88581abf89ec098da84ed8e92aa904c997d
      Author: Pavel Iakubovskii <qubvel@gmail.com>
      Date:   Fri Jul 12 18:20:53 2024 +0000
      
          Add fallback to eager (expensive operation)
      
      commit c29033d30e7ffde4327e8a15cbbc6bee37546f80
      Author: Pavel Iakubovskii <qubvel@gmail.com>
      Date:   Thu Jul 11 17:09:55 2024 +0000
      
          Fix attn_implementation propagation
      
      commit 783aed05f0f38cb2f99e758f81db6838ac55b9f8
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 09:05:27 2024 +0530
      
          style
      
      commit e77e703ca75d00447cda277eca6b886cd32bddc0
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 09:04:57 2024 +0530
      
          add comment to explain why I had to touch forbidden codebase.
      
      commit ab9d8849758e7773a31778ccba71588d18552623
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 09:03:02 2024 +0530
      
          fix: flax attribute access.
      
      commit c570fc0abf9d1bd58c291aae3c7e384f995996d2
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 08:23:54 2024 +0530
      
          fix tensorflow attribute name.
      
      commit 32c812871cfdb268d8a6e3e2c61c5c925c8ed47e
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 07:57:10 2024 +0530
      
          fix attribute access.
      
      commit 4f41a0138b6c417aed9c9332278f8bcd979cb7c2
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Sat May 25 07:44:02 2024 +0530
      
          _from_config.
      
      commit 35aed64ff602422adcf41d7f677a0a24bd9eccae
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 24 18:46:52 2024 +0530
      
          propagation of attn_implementation.
      
      commit 4c25c19845438b1dc1d35a5adf9436151c8c5940
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 24 09:24:36 2024 +0530
      
          style again
      
      commit 5f7dc5c5015c0f8116408f737e8c318d1802c80c
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 24 09:19:05 2024 +0530
      
          use from_config.
      
      commit b70c409956d0359fa6ae5372275d2a20ba7e3389
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 24 09:13:43 2024 +0530
      
          quality
      
      commit a7b63beff53d0fc754c6564e2a7b51731ddee49d
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 14:35:10 2024 +0200
      
          add benchmark numbers
      
      commit 455b0eaea50862b8458c8f422b60fe60ae40fdcb
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 13:50:16 2024 +0200
      
          Revert "reflect feedback more"
      
          This reverts commit dc123e71eff60aae74d5f325f113d515d0d71117.
      
      commit ca674829d28787349c2a9593a14e0f1d41f04ea4
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 13:50:05 2024 +0200
      
          Revert "fix"
      
          This reverts commit 37a1cb35b87acdc4cf7528b8b1ed6da27d244e52.
      
      commit fab2dd8576c099eb1a3464958cb206a664d28247
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 13:47:46 2024 +0200
      
          fix
      
      commit fbc6ae50fd6f2d36294d31e191761631b701d696
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 10 13:38:30 2024 +0200
      
          reflect feedback more
      
      commit 87245bb020b2d60a89afe318a951df0159404fc9
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 08:54:34 2024 +0530
      
          fixes
      
      commit 1057cc26390ee839251e7f8b3326c4207595fb23
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 07:49:03 2024 +0530
      
          don't explicit set attn_implementation in tests
      
      commit e33f75916fc8a99f516b1cf449dbbe9d3aabda81
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 07:43:54 2024 +0530
      
          explicitly override attn_implementation in the towers.
      
      commit 4cf41cb1bc885c39df7cb8f2a0694ebf23299235
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 07:38:42 2024 +0530
      
          import in one-line.
      
      commit f2cc447ae9e74ccfacb448140cdf88259d4afc8c
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri May 3 07:34:58 2024 +0530
      
          move sdpa mention to usage tips.
      
      commit 92884766c64dbb456926a3a84dd427be1349fa95
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Mon Apr 29 10:58:26 2024 +0530
      
          fix: memory allocation problem.
      
      commit d7ffbbfe12f7750b7d0a361420f35c13e0ea787d
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Mon Apr 29 09:56:59 2024 +0530
      
          fix-copies
      
      commit 8dfc3731cedd02e36acd3fe56bb2e6d61efd25d8
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Fri Apr 26 20:16:12 2024 +0530
      
          address arthur's comments.
      
      commit d2ed7b4ce4ff15ae9aa4d3d0500f1544e3dcd9e9
      Author: Sayak Paul <spsayakpaul@gmail.com>
      Date:   Fri Apr 26 20:08:15 2024 +0530
      
          Apply suggestions from code review
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      commit 46e04361f37ded5c522ff05e9f725b9f82dce40e
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Wed Apr 24 09:55:27 2024 +0530
      
          add to docs.
      
      commit 831629158ad40d34d8983f209afb2740ba041af2
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Wed Apr 24 09:33:10 2024 +0530
      
          styling.g
      
      commit d263a119c77314250f4b4c8469caf42559197f22
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Wed Apr 24 09:15:20 2024 +0530
      
          up
      
      commit d44f9d3d7633d4c241a737a1bc317f791f6aedb3
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Tue Apr 23 18:40:42 2024 +0530
      
          handle causal and attention mask
      
      commit 122f1d60153df6666b634a94e38d073f3f260926
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Tue Apr 23 15:18:21 2024 +0530
      
          test fixes.
      
      commit 4382d8cff6fa1dee5dbcf0d06b3e2841231e36f5
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Tue Apr 23 09:39:25 2024 +0530
      
          fix: scaling inside sdpa.
      
      commit 0f629989efc48b7315cf19405a81e02955efe7e5
      Author: Sayak Paul <spsayakpaul@gmail.com>
      Date:   Tue Apr 23 08:14:58 2024 +0530
      
          Update src/transformers/models/clip/modeling_clip.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      commit 14367316877dc27ea40f767ad1aee38bbc97e4ce
      Author: sayakpaul <spsayakpaul@gmail.com>
      Date:   Mon Apr 22 16:21:36 2024 +0530
      
          add: sdpa support to clip.
      
      * Remove fallback for empty attention mask (expensive operation)
      
      * Fix typing in copies
      
      * Add flash attention
      
      * Add flash attention tests
      
      * List CLIP in FA docs
      
      * Fix embeddings attributes and tf
      
      * [run-slow] clip
      
      * Update clip documentation
      
      * Remove commented code, skip compile dynamic for CLIPModel
      
      * Fix doc
      
      * Fix doc 2
      
      * Remove double transpose
      
      * Add torch version check for contiguous()
      
      * Add comment to test mixin
      
      * Fix copies
      
      * Add comment for mask
      
      * Update docs
      
      * [run-slow] clip
      1c37e8c1
  2. 17 Jul, 2024 7 commits
  3. 16 Jul, 2024 13 commits
  4. 15 Jul, 2024 7 commits
  5. 14 Jul, 2024 4 commits