GitLab

* Preliminary work on tokenizers

* Quality + fix tests

* Treat processors

* Fix pad

* Remove all uses of  in tests, docs and examples

* Replace all as_target_tokenizer

* Fix tests

* Fix quality

* Update examples/flax/image-captioning/run_image_captioning_flax.py
Co-authored-by: amyeroberts <amy@huggingface.co>

* Style
Co-authored-by: amyeroberts <amy@huggingface.co>

* [Docs] Fix Speech Encoder Decoder doc sample

* improve pre-processing comment

* make style

* Improve docs

* Improve docs of speech one as well

* Apply suggestions from code review
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>

* Reorganize doc for multilingual support

* Fix style

* Style

* Toc trees

* Adapt templates

* rebase

* Delete shift tokens func

* downsample decoder input seq len for init

* correct attention mask

* add tests

* pt flax cross test

* make fixup

* init file for import

* change pt-flax cross test threshold

* pt-flax test logits only

* move tests

* make repo-consistency

* consistent indentation
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Map model_type and doc pages names

* Add script

* Fix typo

* Quality

* Manual check for Auto
Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>

* Convert all tutorials and guides

* Convert all remaining rst to mdx

* Track and fix bad links