GitLab

* added return_token_type_ids argument for tokenizers which do not generate return_type_ids by default

* fixed styling

* Style
Co-authored-by: LysandreJik <lysandre.debut@reseau.eseo.fr>

* config.activation_function

* solving bug where for small epochs and large gradient_accumulation_steps we never train

* black formatting

* no need to change these files

`T5Tokenizer` instead of `XLNetTokenizer`

* fix issue 3289

* fix attention mask if input_ids None behavior

roberta_chinese_base card

albert_chinese_tiny card

* Create README.md

* model card

* add model card for cased

Remove hardcoded mask_token and use the value provided by the tokenizer.

* XLM-R now passes common tests + Integration tests

* Correct mask index

* Model input names

* Style

* Remove text preprocessing

* Unneccessary import

Adding LM Head to Transfo-XL and first step to fixing problem with Adaptive Embeddings in TransfoXL (#3286)

* first commit

* work in progress

* make language generation task pass

* update to working version for LM

* delete print

* remove dead code

* make style

* passing

* Undo stupid chg

* docs

* undo rename

* delete-cruft

* only import if you have torch

* Dont rely on dict ordering

* Fix dict ordering upstream

* docstring link

* docstring link

* remove trailing comma for 3.5 compat

* new name

* delegate kwarging

* Update kwargs

* Update examples/ner/run_ner.py to use AutoModel

* Fix missing code and apply `make style` command

* ✨ Alter base pl transformer to use automodels

* 🐛 Add batch size env variable to function call

* 💄 Apply black code style from Makefile

* 🚚 Move lightning base out of ner directory

* ✨ Add lightning glue example

* 💄 self

* move _feature_file to base class

* ✨ Move eval logging to custom callback

* 💄 Apply black code style

* 🐛 Add parent to pythonpath, remove copy command

* 🐛 Add missing max_length kwarg

* change do_samples back

* None better default as boolean

* adapt do_sample to True in test example

* make style

* memory benchmark rss

* have both forward pass and line-by-line mem tracing

* cleaned up tracing

* refactored and cleaning up API

* no f-strings yet...

* add GPU mem logging

* fix GPU memory monitoring

* style and quality

* clean up and doc

* update with comments

* Switching to python 3.6+

* fix quality

* Create README.md

* Updated README.md

This model card is intended to be shared among all models under google/bert_uncased_*
(We'll need some support from HuggingFace to get this card cross-linked from all models)

* Add TF2 version of FlauBERT

* Add TF2 version of FlauBERT

* Add documentation

* Apply style and quality

* Apply style once again
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* better error message

* better error message

* update to model identifier instead of url

* update to model identifier instead of ur

* Remove unused kwargs
* dont call forward in tests

Complete merge Seq-2-Seq generation into default generation