"...git@developer.sourcefind.cn:chenpangpang/open-webui.git" did not exist on "b1265c9c3483ecbb6d0f5462c160ce4ea91bda9e"
  1. 02 Jul, 2024 1 commit
    • Sanchit Gandhi's avatar
      [whisper] static kv cache (#31166) · a9701953
      Sanchit Gandhi authored
      
      
      * make work with cache abstraction
      
      * correct for static cache
      
      * hacks for compile
      
      * make fast
      
      * fix
      
      * fix pos ids
      
      * generate
      
      * fix sdpa
      
      * fix sdpa cache pos
      
      * fix fa2
      
      * clean fa2
      
      * integrate cache into generate
      
      * make style
      
      * copies
      
      * more copies
      
      * update eager
      
      * update sdpa
      
      * update fa2
      
      * simplify
      
      * use cache pos
      
      * always compute cross-cache for debug
      
      * avoid recompiles
      Co-authored-by: default avatarArthur Zucker <arthur@huggingface.co>
      
      * fix fix
      
      * fix fix fix
      
      * more fix
      
      * try encoder-decoder cache (too messy)
      
      * revert encoder-decoder cache
      
      * check cross-attn cache
      
      * use enc-dec dataclass
      
      * use richer enc-dec dataclass
      
      * clean-up
      
      * revert static cache changes
      
      * small fixes
      
      * revert to cpu flag
      
      * fix copies
      
      * add static slow test
      
      * past k/v docstring
      
      * more docstrings
      
      * cache_position docstrings
      
      * add to docs
      
      * add enc-dec cache to docs
      
      * make style
      
      * fix after rebase
      
      * fix beam
      
      * style
      
      * fix generation strategies
      
      * fix most decoder-only tests
      
      * style
      
      * skip test
      
      * more clean up
      
      * small docstrings
      
      * Apply suggestions from code review
      Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>
      
      * add todo
      
      * only crop self-attn
      
      * check cache in mixin
      
      * style
      
      * fix re-compile after rebase
      
      * move `is_updated` logic to enc-dec wrapper
      
      * revert back
      
      * revert cache back
      
      * finalise design
      
      * fix
      
      * fix fix
      
      * style
      
      * Update src/transformers/cache_utils.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * deprecate
      
      * updates
      
      * final updates
      
      * style
      
      * style
      
      ---------
      Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      a9701953
  2. 28 Jun, 2024 1 commit
  3. 27 Jun, 2024 3 commits
  4. 26 Jun, 2024 6 commits
  5. 25 Jun, 2024 3 commits
  6. 24 Jun, 2024 1 commit
  7. 21 Jun, 2024 2 commits
  8. 20 Jun, 2024 2 commits
  9. 19 Jun, 2024 3 commits
    • Joao Gante's avatar
      Mamba: add generative tests (#31478) · 83259e40
      Joao Gante authored
      83259e40
    • amyeroberts's avatar
      Use self.config_tester.run_common_tests() (#31431) · 609e6622
      amyeroberts authored
      * First testing updating config tests
      
      * Use run_common_tests
      609e6622
    • Anton Vlasjuk's avatar
      [`GPT2`] Add SDPA support (#31172) · b275a410
      Anton Vlasjuk authored
      * `gpt2` sdpa support
      
      * fix (at least) one test, style, repo consistency
      
      * fix sdpa mask in forward --> fixes generation
      
      * test
      
      * test2
      
      * test3
      
      * test4
      
      * simplify shapes for attn mask creation and small comments
      
      * hub fail test
      
      * benchmarks
      
      * flash attn 2 mask should not be inverted on enc-dec setup
      
      * fix comment
      
      * apply some suggestion from code review
      
      - only save _attn_implentation once
      - remove unnecessary comment
      
      * change elif logic
      
      * [run-slow] gpt2
      
      * modify `test_gpt2_sample_max_time` to follow previous assertion patterns
      b275a410
  10. 17 Jun, 2024 2 commits
    • Albert Villanova del Moral's avatar
      Pass datasets trust_remote_code (#31406) · a14b055b
      Albert Villanova del Moral authored
      * Pass datasets trust_remote_code
      
      * Pass trust_remote_code in more tests
      
      * Add trust_remote_dataset_code arg to some tests
      
      * Revert "Temporarily pin datasets upper version to fix CI"
      
      This reverts commit b7672826.
      
      * Pass trust_remote_code in librispeech_asr_dummy docstrings
      
      * Revert "Pin datasets<2.20.0 for examples"
      
      This reverts commit 833fc17a.
      
      * Pass trust_remote_code to all examples
      
      * Revert "Add trust_remote_dataset_code arg to some tests" to research_projects
      
      * Pass trust_remote_code to tests
      
      * Pass trust_remote_code to docstrings
      
      * Fix flax examples tests requirements
      
      * Pass trust_remote_dataset_code arg to tests
      
      * Replace trust_remote_dataset_code with trust_remote_code in one example
      
      * Fix duplicate trust_remote_code
      
      * Replace args.trust_remote_dataset_code with args.trust_remote_code
      
      * Replace trust_remote_dataset_code with trust_remote_code in parser
      
      * Replace trust_remote_dataset_code with trust_remote_code in dataclasses
      
      * Replace trust_remote_dataset_code with trust_remote_code arg
      a14b055b
    • amyeroberts's avatar
      02c525d2
  11. 14 Jun, 2024 3 commits
  12. 13 Jun, 2024 1 commit
    • Pablo Montalvo's avatar
      add initial design for uniform processors + align model (#31197) · c624d5ba
      Pablo Montalvo authored
      * add initial design for uniform processors + align model
      
      * fix mutable default 馃憖
      
      * add configuration test
      
      * handle structured kwargs w defaults + add test
      
      * protect torch-specific test
      
      * fix style
      
      * fix
      
      * fix assertEqual
      
      * move kwargs merging to processing common
      
      * rework kwargs for type hinting
      
      * just get Unpack from extensions
      
      * run-slow[align]
      
      * handle kwargs passed as nested dict
      
      * add from_pretrained test for nested kwargs handling
      
      * [run-slow]align
      
      * update documentation + imports
      
      * update audio inputs
      
      * protect audio types, silly
      
      * try removing imports
      
      * make things simpler
      
      * simplerer
      
      * move out kwargs test to common mixin
      
      * [run-slow]align
      
      * skip tests for old processors
      
      * [run-slow]align, clip
      
      * !$#@!! protect imports, darn it
      
      * [run-slow]align, clip
      
      * [run-slow]align, clip
      
      * update doc
      
      * improve documentation for default values
      
      * add model_max_length testing
      
      This parameter depends on tokenizers received.
      
      * Raise if kwargs are specified in two places
      
      * fix
      
      * expand VideoInput
      
      * fix
      
      * fix style
      
      * remove defaults values
      
      * add comment to indicate documentation on adding kwargs
      
      * protect imports
      
      * [run-slow]align
      
      * fix
      
      * remove set() that breaks ordering
      
      * test more
      
      * removed unused func
      
      * [run-slow]align
      c624d5ba
  13. 11 Jun, 2024 1 commit
    • amyeroberts's avatar
      Fast image processor (#28847) · f53fe35b
      amyeroberts authored
      
      
      * Draft fast image processors
      
      * Draft working fast version
      
      * py3.8 compatible cache
      
      * Enable loading fast image processors through auto
      
      * Tidy up; rescale behaviour based on input type
      
      * Enable tests for fast image processors
      
      * Smarter rescaling
      
      * Don't default to Fast
      
      * Safer imports
      
      * Add necessary Pillow requirement
      
      * Woops
      
      * Add AutoImageProcessor test
      
      * Fix up
      
      * Fix test for imagegpt
      
      * Fix test
      
      * Review comments
      
      * Add warning for TF and JAX input types
      
      * Rearrange
      
      * Return transforms
      
      * NumpyToTensor transformation
      
      * Rebase - include changes from upstream in ImageProcessingMixin
      
      * Safe typing
      
      * Fix up
      
      * convert mean/std to tesnor to rescale
      
      * Don't store transforms in state
      
      * Fix up
      
      * Update src/transformers/image_processing_utils_fast.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * Update src/transformers/models/auto/image_processing_auto.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * Update src/transformers/models/auto/image_processing_auto.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * Update src/transformers/models/auto/image_processing_auto.py
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      
      * Warn if fast image processor available
      
      * Update src/transformers/models/vit/image_processing_vit_fast.py
      
      * Transpose incoming numpy images to be in CHW format
      
      * Update mapping names based on packages, auto set fast to None
      
      * Fix up
      
      * Fix
      
      * Add AutoImageProcessor.from_pretrained(checkpoint, use_fast=True) test
      
      * Update src/transformers/models/vit/image_processing_vit_fast.py
      Co-authored-by: default avatarPavel Iakubovskii <qubvel@gmail.com>
      
      * Add equivalence and speed tests
      
      * Fix up
      
      ---------
      Co-authored-by: default avatarArthur <48595927+ArthurZucker@users.noreply.github.com>
      Co-authored-by: default avatarPavel Iakubovskii <qubvel@gmail.com>
      f53fe35b
  14. 10 Jun, 2024 4 commits
  15. 07 Jun, 2024 4 commits
    • amyeroberts's avatar
      Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321) · 25245ec2
      amyeroberts authored
      * Rename to test_model_common_attributes
      The method name is misleading - it is testing being able to get and set embeddings, not common attributes to all models
      
      * Explicitly skip
      25245ec2
    • BHUVAN M's avatar
      interpolation added for TVP. (#30863) · 3b9174f2
      BHUVAN M authored
      * Update TVP model to interpolate pre-trained image pad prompter encodings
      
      * feat: Add 2D positional embeddings interpolation in TvpVisualInputEmbedding
      
      * added required comments
      
      * Update TVP model to interpolate pre-trained image pad prompter encodings
      
      * feat: Add 2D positional embeddings interpolation in TvpVisualInputEmbedding
      
      * added required comments
      
      * docstring and argument fix
      
      * doc fixes and test case fix suggested in review.
      
      * varibale typo fix
      
      * styling and name fixes for padding interpolation flag.
      3b9174f2
    • Matt's avatar
      Remove ConversationalPipeline and Conversation object (#31165) · 065729a6
      Matt authored
      * Remove ConversationalPipeline and Conversation object, as they have been deprecated for some time and are due for removal
      
      * Update not-doctested.txt
      
      * Fix JA and ZH docs
      
      * Fix JA and ZH docs some more
      
      * Fix JA and ZH docs some more
      065729a6
    • Cyril Vallez's avatar
      Fix jetmoe model (#31279) · 8bcf9c8d
      Cyril Vallez authored
      * Fix jetmoe model
      
      * Remove skip-tests
      8bcf9c8d
  16. 06 Jun, 2024 3 commits