Commits · c7ccb2e77976931b5738c5d0f89c3de7bb4c5278 · chenpangpang / transformers

22 Oct, 2021 6 commits

Fix assertion in models (#14090) · c7ccb2e7

Baizhou Huang authored Oct 22, 2021



* replace assertions in src/transformers/models/luke/convert_luke_original_pytorch_checkpoint_to_pytorch.py

* replace assertions in src/transformers/models/marian/convert_marian_to_pytorch.py

* Update src/transformers/models/luke/convert_luke_original_pytorch_checkpoint_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/marian/convert_marian_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/marian/convert_marian_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/marian/convert_marian_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/marian/convert_marian_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/marian/convert_marian_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/marian/convert_marian_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/marian/convert_marian_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/marian/convert_marian_to_pytorch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: skpig <1900012999@pku.edu.cn>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

c7ccb2e7

Update Korean README to master · 16d7b70b
Sylvain Gugger authored Oct 22, 2021

16d7b70b
Replace assertions with valueError Exeptions (#14117) · fa4abdb3
Jayesh Dewangan authored Oct 22, 2021
```
* Replace assertions with valueError Exeptions

* Reformatted
```
fa4abdb3

Translate README.md to Korean (#14015) · 9f53f049

Yeoun Yi authored Oct 22, 2021

* Create README_ko.md

* Update README.md

* Update README_zh-hans.md

* Update README_zh-hant.md

* Update README_ko.md

* Update check_copies.py

* Update README_ko.md

* typo

* match with readme_ko

9f53f049

Replace assert statements with exceptions (#13871) (#13901) · f5a49bfa

David del Río Medina authored Oct 22, 2021

* Replace assert statements with exceptions (#13871)

* Change f-strings when not needed (flake8)

* Replace assert statements with exceptions (#13871)

* Change f-strings when not needed (flake8)

* Improve error message as suggested by reviewer

* Fix identation bug

* Fix style errors

f5a49bfa

up (#14116) · 70f186f6
Patrick von Platen authored Oct 22, 2021

70f186f6

21 Oct, 2021 12 commits
- Changed asserts to ValueError (#14091) · ca2ef7df
  Deepanshu verma authored Oct 22, 2021
  
  ca2ef7df
- Fix a typo in preprocessing docs (#14108) · 7888914e
  Reza Gharibi authored Oct 22, 2021
  
  7888914e
- fix typo in license docstring (#14094) · d432a654
  lee1jun authored Oct 22, 2021
```
last line: "# limitations under the License." is missing
```
  d432a654
- Replace assertion with ValueError exception (#14098) · 7af55d3a
  David del Río Medina authored Oct 21, 2021
  
  7af55d3a
- Fix typo in comment (#14102) · f00bceab
  stalkermustang authored Oct 21, 2021
  
  f00bceab
- Fix ignore_mismatched_sizes (#14085) · 234cfefb
  Li-Huai (Allan) Lin authored Oct 22, 2021
```
* Fix

* Style

* Name

* Fix tests

* Style

* Remove embed sizes checking

* Disable some tests

* Fix

* Apply suggestion
```
  234cfefb
- [Examples] Add audio classification notebooks (#14099) · e03544a1
  Anton Lozhkov authored Oct 21, 2021
```
* Update SEW integration test tolerance

* Add audio classification notebooks
```
  e03544a1
- Pin PyTorch to make CI green · 0f502682
  Sylvain Gugger authored Oct 21, 2021
  
  0f502682
- Replace "Masked" with "Causal" in TF CLM example (#14014) · f9c16b02
  Christopher Akiki authored Oct 21, 2021
  
  f9c16b02
- Replace assertions with ValueError exceptions (#14061) · 31872282
  David del Río Medina authored Oct 21, 2021
```
* Replace assertions with ValueError exceptions

* Format error messages as suggested
```
  31872282
- Change asserts in src/transformers/models/xlnet/ to raise ValueError (#14088) · 9e4ea251
  Weston King-Leatham authored Oct 21, 2021
```
* Change asserts in src/transformers/models/xlnet/ to raise ValueError

* Update src/transformers/models/xlnet/modeling_tf_xlnet.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
```
  9e4ea251
- up (#14093) · e9d2a639
  Patrick von Platen authored Oct 21, 2021
  
  e9d2a639
20 Oct, 2021 10 commits
- Fix broken link in translation section (#14087) · 49155d24
  Reza Gharibi authored Oct 20, 2021
  
  49155d24
- Context managers (#13900) · 0270d44f
  Leandro von Werra authored Oct 20, 2021
```
* add `ContextManagers` for lists of contexts

* fix import sorting

* add `ContextManagers` tests
```
  0270d44f
- Fix label attribution in token classification examples (#14055) · f875fb0e
  Sylvain Gugger authored Oct 20, 2021
  
  f875fb0e
- Fix assert in src/transformers/data/datasets/language_modeling.py (#14077) · 31560f63
  Baizhou Huang authored Oct 20, 2021
```
* replace assertion with ValueError

* fix code style
Co-authored-by: skpig <1900012999@pku.edu.cn>
```
  31560f63
- Fix missing autocast() in Trainer.prediction_step() (#14075) · 0106826a
  Kwanghee Choi authored Oct 20, 2021
```
Co-authored-by: jonas <jonas@hpcnt.com>
```
  0106826a
- replace assert with exception in src/transformers/utils/model_pararallel_utils.py (#14072) · a43d9352
  Baizhou Huang authored Oct 20, 2021
```
* replace assert with exception in src/transformers/utils/model_parallel_utils.py

* fix some code style

* fix typo
Co-authored-by: skpig <1900012999@pku.edu.cn>
```
  a43d9352
- up (#14079) · 53dc39d8
  Patrick von Platen authored Oct 20, 2021
  
  53dc39d8
- Add ASR colabs (#14067) · 0bc2e54f
  Patrick von Platen authored Oct 20, 2021
```
* up

* Update notebooks/README.md
```
  0bc2e54f
- [Examples] Use Audio feature in speech classification (#14052) · dbaf4920
  Anton Lozhkov authored Oct 20, 2021
```
* Update SEW integration test tolerance

* Update audio classification

* Update test

* Remove torchaudio

* Add dataset revision

* Hub branch naming

* Revert dataset revisions

* Update datasets
```
  dbaf4920
- Trainer._load_rng_state() path fix (#14069) (#14071) · 3fefa292
  Robert Stone authored Oct 19, 2021
  
  3fefa292
19 Oct, 2021 3 commits
- update to_py_obj to support np.number (#14064) · 3892d09f
  Meng Zhou authored Oct 20, 2021
```
Co-authored-by: 眸浩 <mouhao.zm@alibaba-inc.com>
```
  3892d09f
- TF Model train and eval step metrics for seq2seq models. (#14009) · 122c2f81
  Pedro Marques authored Oct 19, 2021
```
* TF Model train and eval step metrics for seq2seq models.

When using a model with a seq2seq output compute metrics against logits.

* Removing vestigial code
Co-authored-by: matt <rocketknight1@gmail.com>
```
  122c2f81
- Fix passing None as concrete args (#14022) · fde4867f
  Thomas Wang authored Oct 19, 2021
  
  fde4867f
18 Oct, 2021 9 commits

Fix typo (#14056) · 9eda0d15
Ihor Omelchenko authored Oct 19, 2021

9eda0d15
fix typo (#14049) · 7a3147e9
Weizhe Yuan authored Oct 19, 2021

7a3147e9
[Speech] Refactor Examples (#14040) · d5ff69fc
Patrick von Platen authored Oct 18, 2021
```
* adapt_examples

* up

* up

* up

* up

* add auto models

* finish
```
d5ff69fc
Fix save when laod_best_model_at_end=True (#14054) · 2024faf1
Sylvain Gugger authored Oct 18, 2021

2024faf1

Add an API to register objects to Auto classes (#13989) · 2c60ff2f

Sylvain Gugger authored Oct 18, 2021



* Add API to register a new object in auto classes

* Fix test

* Documentation

* Add to tokenizers and test

* Add cleanup after tests

* Be more careful

* Move import

* Move import

* Cleanup in TF test too

* Add consistency check

* Add documentation

* Style

* Update docs/source/model_doc/auto.rst
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/models/auto/auto_factory.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

2c60ff2f

Add BARTpho: Pre-trained Sequence-to-Sequence Models for Vietnamese (#13788) · 3d587c53

Dat Quoc Nguyen authored Oct 18, 2021



* Add the pre-trained BARTpho model

* Add the pre-trained BARTpho model

* Add the pre-trained BARTpho model

* Fix incorrectly sorted and/or formatted imports

* Fix incorrectly sorted and/or formatted style

* Fix check_dummies

* Fix check_dummies

* Fix check_dummies

* Update docs/source/model_doc/bartpho.rst
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Update src/transformers/models/bartpho/__init__.py
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Update src/transformers/models/bartpho/tokenization_bartpho.py
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Update tests/test_tokenization_bartpho.py
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Update src/transformers/models/bartpho/tokenization_bartpho.py
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Update tests/test_tokenization_bartpho.py
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Update docs/source/model_doc/bartpho.rst
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/model_doc/bartpho.rst
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/bartpho/__init__.py
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* Add the pre-trained BARTpho model

* Add Tips section in doc and details of monolingual_vocab_file

* Fix conflicts

* Add another tip related to monolingual_vocab_file

* Readd dependency_versions_table.py

* Handle failing checks

* Remove test_list.txt

* Remove md5sum.saved

* Revise Readme.md
Co-authored-by: Suraj Patil <surajp815@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

3d587c53

up (#14046) · 7c6cd0ac
Patrick von Platen authored Oct 18, 2021

7c6cd0ac
Update SEW integration test tolerance (#14048) · 82b62fa6
Anton Lozhkov authored Oct 18, 2021

82b62fa6
[Speech] Move all examples to new audio feature (#14045) · bdf31d6e
Patrick von Platen authored Oct 18, 2021
```
* up

* up

* up

* finish
```
bdf31d6e