GitLab

* initial pytorch lightning commit

* tested multigpu

* Fix learning rate schedule

* black formatting

* fix flake8

* isort

* isort

* .
Co-authored-by: Check your git settings! <chris@chris-laptop>

see 1ebfeb79

 and #2728
Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

* pass langs parameter to certain XLM models

Adding an argument that specifies the language the SQuAD dataset is in so language-sensitive XLMs (e.g. `xlm-mlm-tlm-xnli15-1024`) don't default to language `0`.
Allows resolution of issue #1799 .

* fixing from `make style`

* fixing style (again)

Masked indices should have -1 and not -100. Updating documentation + scripts that were forgotten

"%s-%d".format() -> "{}-{}".format()

ping @lysandrejik

cc @lysandrejik

Rul -> Run