Commits · a2b7d19bd700367bb14fd8997d612bc20781be37 · chenpangpang / transformers

"vscode:/vscode.git/clone" did not exist on "bf2c36a92091a5aa28c34fc944d020a76a92a922"

06 Apr, 2022 3 commits
- Fix seq2seq doc tests (#16606) · a2b7d19b
  Suraj Patil authored Apr 06, 2022
```
* fix bart and mbart

* add ckpt names as variables

* fix mbart

* fix plbart

* use varibale for ckot name
```
  a2b7d19b
- [Minds14] Correct quicktour (#16626) · 0bf18643
  Patrick von Platen authored Apr 06, 2022
  
  0bf18643
- fix default num_attention_heads in segformer doc (#16612) · d55fcbcc
  Jun authored Apr 06, 2022
  
  d55fcbcc
05 Apr, 2022 13 commits

added type hints to CTRL pytorch (#16593) · b18dfd95

Anmol Joshi authored Apr 05, 2022

* Completed documentation of CTRL

* Missing optional None

* Added return types

* updated imports

* Update modeling_ctrl.py

b18dfd95

Quality · 208f4c10
Sylvain Gugger authored Apr 05, 2022

208f4c10

Update summary of the tasks (#16528) · f553c3ce

Steven Liu authored Apr 05, 2022

* 📝 add image/vision classification and asr

* 🖍

 minor formatting fixes

* Fixed a typo in legacy seq2seq_trainer.py (#16531)

* Add ONNX export for BeiT (#16498)

* Add beit onnx conversion support

* Updated docs

* Added cross reference to ViT ONNX config

* call on_train_end when trial is pruned (#16536)

* Type hints added (#16529)

* Fix Bart type hints (#16297)

* Add type hints to PLBart PyTorch

* Remove pending merge conflicts

* Fix PLBart Type Hints

* Add changes from review

* Add VisualBert type hints (#16544)

* Adding missing type hints for mBART model (PyTorch) (#16429)

* added type hints for mbart tensorflow tf implementation

* Adding missing type hints for mBART model 

Tensorflow Implementation model added with missing type hints

* Missing Type hints - correction

For TF model

* Code fixup using make quality tests

* Hint types - typo error

* make fix-copies and make fixup

* type hints

* updated files

* type hints update

* making dependent modesls coherent
Co-authored-by: matt <rocketknight1@gmail.com>

* Remove MBart subclass of XLMRoberta in tokenzier docs (#16546)

* Remove MBart subclass of XLMRoberta in tokenzier

* Fix style

* Copy docs from MBart50 tokenizer

* Use random_attention_mask for TF tests (#16517)

* use random_attention_mask for TF tests

* Fix for TFCLIP test (for now).
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* Improve code example (#16450)
Co-authored-by: Niels Rogge <nielsrogge@nielss-mbp.home>

* Pin tokenizers version <0.13 (#16539)

* Pin tokenizers version <0.13

* Style

* Add code samples for TF speech models (#16494)
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* [FlaxSpeechEncoderDecoder] Fix dtype bug (#16581)

* [FlaxSpeechEncoderDecoder] Fix dtype bug

* more fixes

* Making the impossible to connect error actually report the right URL. (#16446)

* Fix flax import in __init__.py: modeling_xglm -> modeling_flax_xglm (#16556)

* Add utility to find model labels (#16526)

* Add utility to find model labels

* Use it in the Trainer

* Update src/transformers/utils/generic.py
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>

* Quality
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>

* Enable doc in Spanish (#16518)

* Reorganize doc for multilingual support

* Fix style

* Style

* Toc trees

* Adapt templates

* Add use_auth to load_datasets for private datasets to PT and TF examples (#16521)

* fix formatting and remove use_auth

* Add use_auth_token to Flax examples

* add a test checking the format of `convert_tokens_to_string`'s output (#16540)

* add new tests

* add comment to overridden tests

* TF: Finalize `unpack_inputs`-related changes (#16499)

* Add unpack_inputs to remaining models

* removed kwargs to `call()` in TF models

* fix TF T5 tests

* [SpeechEncoderDecoderModel] Correct Encoder Last Hidden State Output (#16586)

* initialize the default rank set on TrainerState (#16530)

* initialize the default rank set on TrainerState

* fix style

* Trigger doc build

* Fix CI: test_inference_for_pretraining in ViTMAEModelTest (#16591)
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

* add a template to add missing tokenization test (#16553)

* add a template to add missing tokenization test

* add cookiecutter setting

* improve doc

* Update templates/adding_a_missing_tokenization_test/README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* made _load_pretrained_model_low_mem static + bug fix (#16548)

* handle torch_dtype in low cpu mem usage (#16580)

* [Doctests] Correct filenaming (#16599)

* [Doctests] Correct filenaming

* improve quicktour

* make style

* Adding new train_step logic to make things less confusing for users (#15994)

* Adding new train_step logic to make things less confusing for users

* DO NOT ASK WHY WE NEED THAT SUBCLASS

* Metrics now working, at least for single-output models with type annotations!

* Updates and TODOs for the new train_step

* Make fixup

* Temporary test workaround until T5 has types

* Temporary test workaround until T5 has types

* I think this actually works! Needs a lot of tests though

* MAke style/quality

* Revert changes to T5 tests

* Deleting the aforementioned unmentionable subclass

* Deleting the aforementioned unmentionable subclass

* Adding a Keras API test

* Style fixes

* Removing unneeded TODO and comments

* Update test_step too

* Stop trying to compute metrics with the dummy_loss, patch up test

* Make style

* make fixup

* Docstring cleanup

* make fixup

* make fixup

* Stop expanding 1D input tensors when using dummy loss

* Adjust T5 test given the new compile()

* make fixup

* Skipping test for convnext

* Removing old T5-specific Keras test now that we have a common one

* make fixup

* make fixup

* Only skip convnext test on CPU

* Update src/transformers/modeling_tf_utils.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_utils.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Avoiding TF import issues

* make fixup

* Update compile() to support TF 2.3

* Skipping model.fit() on template classes for now

* Skipping model.fit() on template class tests for now

* Replace ad-hoc solution with find_labels

* make fixup
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Adding missing type hints for BigBird model   (#16555)

* added type hints for mbart tensorflow tf implementation

* Adding missing type hints for mBART model 

Tensorflow Implementation model added with missing type hints

* Missing Type hints - correction

For TF model

* Code fixup using make quality tests

* Hint types - typo error

* make fix-copies and make fixup

* type hints

* updated files

* type hints update

* making dependent modesls coherent

* Type hints for BigBird

* removing typos
Co-authored-by: matt <rocketknight1@gmail.com>

* [deepspeed] fix typo, adjust config name (#16597)

* 🖍

 apply feedback
Co-authored-by: Cathy <815244047@qq.com>
Co-authored-by: Jim Rohrer <jrohrer1@gmail.com>
Co-authored-by: Ferdinand Schlatt <fschlatt@gmail.com>
Co-authored-by: Dahlbomii <101373053+Dahlbomii@users.noreply.github.com>
Co-authored-by: Gunjan Chhablani <chhablani.gunjan@gmail.com>
Co-authored-by: Rishav Chandra Varma <rishavchandra.v16@iiits.in>
Co-authored-by: matt <rocketknight1@gmail.com>
Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: Niels Rogge <nielsrogge@nielss-mbp.home>
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
Co-authored-by: Daniel Stancl <46073029+stancld@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>
Co-authored-by: Karim Foda <35491698+KMFODA@users.noreply.github.com>
Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com>
Co-authored-by: Joao Gante <joao@huggingface.co>
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com>
Co-authored-by: Andres Codas <andrescodas@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <Sylvain.gugger@gmail.com>
Co-authored-by: Francesco Saverio Zuppichini <francesco.zuppichini@gmail.com>
Co-authored-by: Suraj Patil <surajp815@gmail.com>
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

f553c3ce

[benchmark tool] trainer-benchmark.py (#14934) · 23fc4cba

Stas Bekman authored Apr 05, 2022

* [benchmark tool] trainer-benchmark.py

* improve

* massive rework/expansion

* fix

* mucho improved

* improved

* fix prefix

* fix

* fix diff calculation

* address suggestions

23fc4cba

Add global_attention_mask to gen_kwargs (#16485) · b33ab4eb

John Giorgi authored Apr 05, 2022

If global_attention_mask is found in the models inputs (used by certain
models, like LED) in the prediction_step method of Seq2SeqTrainer,
it is added to the gen_kwargs, which are passed to model.decode().
This allows us to properly set the global attention when decoding.

b33ab4eb

[deepspeed] fix typo, adjust config name (#16597) · 9fd5e6bb
Stas Bekman authored Apr 05, 2022

9fd5e6bb

Adding missing type hints for BigBird model (#16555) · 367558b9

Rishav Chandra Varma authored Apr 05, 2022



* added type hints for mbart tensorflow tf implementation

* Adding missing type hints for mBART model 

Tensorflow Implementation model added with missing type hints

* Missing Type hints - correction

For TF model

* Code fixup using make quality tests

* Hint types - typo error

* make fix-copies and make fixup

* type hints

* updated files

* type hints update

* making dependent modesls coherent

* Type hints for BigBird

* removing typos
Co-authored-by: matt <rocketknight1@gmail.com>

367558b9

Adding new train_step logic to make things less confusing for users (#15994) · 43540052

Matt authored Apr 05, 2022



* Adding new train_step logic to make things less confusing for users

* DO NOT ASK WHY WE NEED THAT SUBCLASS

* Metrics now working, at least for single-output models with type annotations!

* Updates and TODOs for the new train_step

* Make fixup

* Temporary test workaround until T5 has types

* Temporary test workaround until T5 has types

* I think this actually works! Needs a lot of tests though

* MAke style/quality

* Revert changes to T5 tests

* Deleting the aforementioned unmentionable subclass

* Deleting the aforementioned unmentionable subclass

* Adding a Keras API test

* Style fixes

* Removing unneeded TODO and comments

* Update test_step too

* Stop trying to compute metrics with the dummy_loss, patch up test

* Make style

* make fixup

* Docstring cleanup

* make fixup

* make fixup

* Stop expanding 1D input tensors when using dummy loss

* Adjust T5 test given the new compile()

* make fixup

* Skipping test for convnext

* Removing old T5-specific Keras test now that we have a common one

* make fixup

* make fixup

* Only skip convnext test on CPU

* Update src/transformers/modeling_tf_utils.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_utils.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Avoiding TF import issues

* make fixup

* Update compile() to support TF 2.3

* Skipping model.fit() on template classes for now

* Skipping model.fit() on template class tests for now

* Replace ad-hoc solution with find_labels

* make fixup
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

43540052

[Doctests] Correct filenaming (#16599) · 7ccacdf1
Patrick von Platen authored Apr 05, 2022
```
* [Doctests] Correct filenaming

* improve quicktour

* make style
```
7ccacdf1
handle torch_dtype in low cpu mem usage (#16580) · 21decb77
Suraj Patil authored Apr 05, 2022

21decb77
made _load_pretrained_model_low_mem static + bug fix (#16548) · 8bf6d28c
Francesco Saverio Zuppichini authored Apr 05, 2022

8bf6d28c

add a template to add missing tokenization test (#16553) · 02214cb3

SaulLu authored Apr 05, 2022



* add a template to add missing tokenization test

* add cookiecutter setting

* improve doc

* Update templates/adding_a_missing_tokenization_test/README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

02214cb3

Fix CI: test_inference_for_pretraining in ViTMAEModelTest (#16591) · 765bafb8
Yih-Dar authored Apr 05, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
765bafb8

04 Apr, 2022 11 commits
- Trigger doc build · 104c0652
  Sylvain Gugger authored Apr 04, 2022
  
  104c0652
- initialize the default rank set on TrainerState (#16530) · 1cd2e21d
  Andres Codas authored Apr 04, 2022
```
* initialize the default rank set on TrainerState

* fix style
```
  1cd2e21d
- [SpeechEncoderDecoderModel] Correct Encoder Last Hidden State Output (#16586) · 6f9d8dc1
  Sanchit Gandhi authored Apr 04, 2022
  
  6f9d8dc1
- TF: Finalize `unpack_inputs`-related changes (#16499) · dad5ca83
  Joao Gante authored Apr 04, 2022
```
* Add unpack_inputs to remaining models

* removed kwargs to `call()` in TF models

* fix TF T5 tests
```
  dad5ca83
- add a test checking the format of `convert_tokens_to_string`'s output (#16540) · be9474bd
  SaulLu authored Apr 04, 2022
```
* add new tests

* add comment to overridden tests
```
  be9474bd
- Add use_auth to load_datasets for private datasets to PT and TF examples (#16521) · 24a85cca
  Karim Foda authored Apr 04, 2022
```
* fix formatting and remove use_auth

* Add use_auth_token to Flax examples
```
  24a85cca
- Enable doc in Spanish (#16518) · b9a768b3
  Sylvain Gugger authored Apr 04, 2022
```
* Reorganize doc for multilingual support

* Fix style

* Style

* Toc trees

* Adapt templates
```
  b9a768b3
- Add utility to find model labels (#16526) · 3951b9f3
  Sylvain Gugger authored Apr 04, 2022
```
* Add utility to find model labels

* Use it in the Trainer

* Update src/transformers/utils/generic.py
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>

* Quality
Co-authored-by: Matt <Rocketknight1@users.noreply.github.com>
```
  3951b9f3
- Fix flax import in __init__.py: modeling_xglm -> modeling_flax_xglm (#16556) · ec4da72f
  Daniel Stancl authored Apr 04, 2022
  
  ec4da72f
- Making the impossible to connect error actually report the right URL. (#16446) · 013a7dbe
  Nicolas Patry authored Apr 04, 2022
  
  013a7dbe
- [FlaxSpeechEncoderDecoder] Fix dtype bug (#16581) · ad0cba08
  Patrick von Platen authored Apr 04, 2022
```
* [FlaxSpeechEncoderDecoder] Fix dtype bug

* more fixes
```
  ad0cba08
01 Apr, 2022 12 commits
- Add code samples for TF speech models (#16494) · 60d27b1f
  Yih-Dar authored Apr 01, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  60d27b1f
- Pin tokenizers version <0.13 (#16539) · 53a4d6b1
  Lysandre Debut authored Apr 01, 2022
```
* Pin tokenizers version <0.13

* Style
```
  53a4d6b1
- Improve code example (#16450) · 61ee26a8
  NielsRogge authored Apr 01, 2022
```
Co-authored-by: Niels Rogge <nielsrogge@nielss-mbp.home>
```
  61ee26a8
- Use random_attention_mask for TF tests (#16517) · 2199382d
  Yih-Dar authored Apr 01, 2022
```
* use random_attention_mask for TF tests

* Fix for TFCLIP test (for now).
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  2199382d
- Remove MBart subclass of XLMRoberta in tokenzier docs (#16546) · 823dbf8a
  Gunjan Chhablani authored Apr 01, 2022
```
* Remove MBart subclass of XLMRoberta in tokenzier

* Fix style

* Copy docs from MBart50 tokenizer
```
  823dbf8a
- Adding missing type hints for mBART model (PyTorch) (#16429) · 5fe06b9b
  Rishav Chandra Varma authored Apr 01, 2022
```
* added type hints for mbart tensorflow tf implementation

* Adding missing type hints for mBART model 

Tensorflow Implementation model added with missing type hints

* Missing Type hints - correction

For TF model

* Code fixup using make quality tests

* Hint types - typo error

* make fix-copies and make fixup

* type hints

* updated files

* type hints update

* making dependent modesls coherent
Co-authored-by: matt <rocketknight1@gmail.com>
```
  5fe06b9b
- Add VisualBert type hints (#16544) · 9947dd07
  Gunjan Chhablani authored Apr 01, 2022
  
  9947dd07
- Fix Bart type hints (#16297) · 59a9c83e
  Gunjan Chhablani authored Apr 01, 2022
```
* Add type hints to PLBart PyTorch

* Remove pending merge conflicts

* Fix PLBart Type Hints

* Add changes from review
```
  59a9c83e
- Type hints added (#16529) · afc5a1ea
  Dahlbomii authored Apr 01, 2022
  
  afc5a1ea
- call on_train_end when trial is pruned (#16536) · 483a9450
  Ferdinand Schlatt authored Apr 01, 2022
  
  483a9450
- Add ONNX export for BeiT (#16498) · 9de70f21
  Jim Rohrer authored Apr 01, 2022
```
* Add beit onnx conversion support

* Updated docs

* Added cross reference to ViT ONNX config
```
  9de70f21
- Fixed a typo in legacy seq2seq_trainer.py (#16531) · bfeff6cc
  Cathy authored Apr 01, 2022
  
  bfeff6cc
31 Mar, 2022 1 commit

[research] link to the XTREME-S paper (#16519) · 5807054b

Anton Lozhkov authored Mar 31, 2022



* [research] link to the XTREME-S paper

* Update examples/research_projects/xtreme-s/README.md
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

5807054b