GitLab

* [examples] max samples can't be bigger than then len of dataset

* do tf and flax

* Split file_utils in several submodules

* Fixes

* Add back more objects

* More fixes

* Who exactly decided to import that from there?

* Second suggestion to code with code review

* Revert wront move

* Fix imports

* Adapt all imports

* Adapt all imports everywhere

* Revert this import, will fix in a separate commit

* Updates the default branch from master to main

* Links from `master` to `main`

* Typo

* Update examples/flax/README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Remove input and target reset after preprocessing

* Update run_summarization.py

* Fixed languages and added missing code

* fixed obj, docs, removed source_lang and target_lang

* make style, run_summarization.py reformatted

* [examples/summarization] deal with None in data records

* rewrite to use a simpler (slower) variant

* Update run_glue.py

* Update run_glue.py

* Add model creation snippet to other scripts

* Fix style

* Add push_to_hub to no_trainer examples

* Quality

* Document integration

* Roll out to other examples

* finish

* delete bogus file

* correct some stuff

* finish

* finish

* Add generate kwargs to Seq2SeqTrainingArguments

* typo

* Address review comments + doc

* Style

* Update torch.utils.data namespaces to the latest.

* Format

* Update Dataloader.

* Style

* added cotext manager to datasets map

* fixed style and spaces

* fixed warning of deprecation

* changed desc

* added log_level

* fix comment

* fixed log_level

* Trigger CI

* Unfied logging

* simplified args for log_level