GitLab

Return NP instead of TF tensors for our data loading pipeline

fix broken link

fix
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* Clean all models

* Style

* Last to remove

* address review comments

* Address review comments

* added tasks from SUPPORTED_TASKS to docstrings

* make style

* sorted the tasks in the docstrtings in alphabetical order

* fix all issues with unk token

* fixup

* Replace reduce_labels with do_reduce_labels

* Replace only for __init__ and preprocess

* Add class properties with warnings

* Update tests

* use streaming dataset

* fix whisper's test

* add rescale argument to chunk_iter

* wip: adding tf example for semantic segmentation guide

* completed the working example in tf

* make style

* Update docs/source/en/tasks/semantic_segmentation.mdx
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/tasks/semantic_segmentation.mdx
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* fixed a callback doc links
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Split the examples by modality, added missing examples

* fixed a link

* Update imports and test fetcher

* Revert but keep test fetcher update

* Fix imports

* Fix all imports

* Replace fe with ip names

* Add generate kwargs to `AutomaticSpeechRecognitionPipeline` (#20952)

* Add generate kwargs to AutomaticSpeechRecognitionPipeline

* Add test for generation kwargs

* Update image processor parameters if creating with kwargs (#20866)

* Update parameters if creating with kwargs

* Shallow copy to prevent mutating input

* Pass all args in constructor dict - warnings in init

* Fix typo

* Rename tester class

* Rebase and tidy up

* Fixup

* Use ImageProcessingSavingTestMixin

* Update property ref in tests

* Update property ref in tests

* Update recently merged in models

* Small fix
Co-authored-by: bofeng huang <bofenghuang7@gmail.com>

* Replace reduce_labels with do_reduce_labels

* Replace only for __init__ and preprocess

* Update tests

* Add Japanese translation installation.mdx

* Fixed for consistency with english version

* fix ReformerForSequenceClassification doc example

* fix ReformerForMaskedLM doc example
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* Optimize by not computing gradients for parameters set to requires_grad=False

* Make change to retrigger the build

* Fix isort issue

* Fix issue

* Extend conversion script

* Remove print statement
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>

* Add test_image_processing_common.py

* Fix typo

* Update imports and test fetcher

* Revert but keep test fetcher update

* Fix imports

* Fix all imports

* Formatting fix

* Update tests/test_image_processing_common.py

* add converter for t5x_retrieval model

* update args

* Update src/transformers/models/t5/convert_t5x_checkpoint_to_pytorch.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* style  editing -> convert t5x to pytorch

* make style
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* First draft

* More improvements

* Add conversion script

* More improvements

* Add docs

* Address review

* Rename class to ConvEncoder

* Address review

* Apply suggestion

* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update all DETR friends

* Add corresponding test

* Improve test

* Fix bug

* Add more tests

* Set out_features to last stage by default
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MBP.localdomain>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fix `blip` doctest

* Update src/transformers/models/blip/modeling_blip.py
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

skip failing test for now

* fix `blip` docstring

* fix typo

* fix another typo

* Microphone live inference catching up when inference is too slow
(whisper).

* Adding copyright.

* Remove all hf-internal-testing checkpoints that can be removed

* Fix copies

* Put back processor_class in TF example

* Address review comment

* add outputs to code snippets

* fix example text

* apply feedback

* style changes

* make style

* Fix processor

* Fix shape in docstring

* split tests

* test CI

* add if else
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

change text to sentence

Replace the checkpoint - the current one has shape issue
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

fix typo + remove non-existent entry
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* update huggingface_hub version

* revert changes in setup.py
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

deleted references of self.vocab_size and self.type_vocab_size for multiple models [TF implementation] (#21164)

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update docs examples FE -> IP

* Remove _IMAGE_PROCESSOR_FOR_DOC