GitLab

* Use  instead of  from huggingface_hub

* bump huggingface_hub to 0.10.0 + make deps_table_update

* fix opt softmax nit

- Use the same logic as 1eb09537550734a783c194e416029cb9bc4cb119 for consistency

* Update src/transformers/models/opt/modeling_opt.py

The `labels` variable is not defined, the `model_inputs` already contain this information.

* chore: initial commit

* chore: adding util methods

yet to work on the nn.functional.interpolate port with align_corener=True

* chore: refactor the utils

* used tf.compat.v1.image.resize to align the F.interpolate function
* added type hints to the method signatures
* added references to the gists where one 2 one alignment of torch and tf has been shown

* chore: adding the layers

* chore: porting all the layers from torch to tf

This is the initial draft, nothing is tested yet.

* chore: aligning the layers with reference to tf clip

* chore: aligning the modules

* added demaraction comments
* added copied and adapted from comments

* chore: aligning with CLIP

* chore: wrangling the layers to keep it tf compatible

* chore: aligning the names of the layers for porting

* chore: style changes

* chore: adding docs and inits

* chore: adding tfp dependencis

the code is taken from TAPAS

* chore: initial commit for testing

* chore: aligning the vision embeddings with the vit implementatino

* chore: changing model prefix

* chore: fixing the name of the model and the layer normalization test case

* chore: every test passes but the slow ones

* chore: fix style and integration test

* chore: moving comments below decorators

* chore: make fixup and fix-copies changes

* chore: adding the Vision and Text Model to check_repo

* chore: modifying the prefix name to align it with the torch implementation

* chore: fix typo in configuration

* choer: changing the name of the model variable

* chore: adding segmentation flag

* chore: gante's review

* chore: style refactor

* chore: amy review

* chore: adding shape_list to parts that have been copied from other snippets

* chore: init batchnorm with torch defaults

* chore: adding shape_list to pass the tests

* test fix: adding seed as 0

* set seed

* chore: changing the straight through trick to fix -ve dimensinos

* chore: adding a dimension to the loss

* chore: adding reviewers and contributors names to the docs

* chore: added changes after review

* chore: code quality fixup

* chore: fixing the segmentation snippet

* chore: adding  to the layer calls

* chore: changing int32 to int64 for inputs of serving

* chore: review changes

* chore: style changes

* chore: remove from_pt=True

* fix: repo consistency
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* fix fp16 for xglm

* Removed misleading comment

* Fix undefined variable
Co-authored-by: Gabriele Sarti <gsarti@amazon.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* 📝 reframe docs around preprocessing classes

* small edits

* edits and review

* fix typo

* apply review

* clarify processor

* move autoclasses to main classes

* keep auto.mdx in model_doc

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* fix args option

* fix trainer eval log

* fix out of memory qa script

* do isort, black, flake

* fix tokenize target

* take it back.

* fix: comment

* Document and validate typical_p in generation

* Fix doctest for TFDeiTForImageClassification

* Remove unnecessary tf.random.set_seed
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* Improve deprecation warning for return_all_scores

* Fix formatting

* add warning when left padding should be used

* PT: check for pad token; FLAX: can only check while not tracing

* Added tests for yaml and json

* Added tests for yaml and json

* Use math.pi
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* More tests for regression in cached non existence

* Style

* Add a gpt_j_residual argument to control the residual computing way

* Put duplicate code outside of the if block

* Rename parameter "gpt_j_residual" to "use_parallel_residual" and set the default value to True

* add doc for hyperparameter search

* update doc

* add wav2vec2_alignment

* Update alignment.py

* Update examples/research_projects/wav2vec2/alignment.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update examples/research_projects/wav2vec2/alignment.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update examples/research_projects/wav2vec2/alignment.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update examples/research_projects/wav2vec2/alignment.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Update README.md

* fix style

* fix imports

* fix multithread

* fix bash script

* [@anton-l] Style fixes and docstrings

* [@anton-l] Style fixes and docstrings

* Update alignment.py

fix blank id in backtrack
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: anton-l <aglozhkov@gmail.com>

* remove unused cur_len in generation_utils.py

* linting

* Fix cached_file in offline mode for cached non-existing files

* Add tests

* Test with offline mode

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* Changed json_file_parser function and added yaml parser function

* update hf_argparser

* Added allow_extra_keys argument

* Use repo_type instead of deprecated datasets repo IDs

* Add missing one in doc

Co-authored-by: Ankur Goyal <ankur@impira.com>

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

Bumps [protobuf](https://github.com/protocolbuffers/protobuf) from 3.19.4 to 3.19.5.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/generate_changelog.py)
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.19.4...v3.19.5

)

---
updated-dependencies:
- dependency-name: protobuf
  dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Remove pos arg from Perceiver's Pre/Postprocessors

* Revert the removed pos args in public methods

* separate images

* Fix condition
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* correct spelling in README

* processing

* german training

* accelerate

* german model sharing

* build doc

* ttf links

* casing

The overwrite_cache parameter is declared twice.

* fix incorrect comments about atten mask

* typo

* Update for CodeGen
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* send slack report for offline runners
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>