Commits · 53e33e6f1be980353e8cd3f75c7cf1e58720f557 · chenpangpang / transformers

"git@developer.sourcefind.cn:Wenxuan/LightX2V.git" did not exist on "c926b08a22622e1273826854501be2490db92a61"

02 Sep, 2022 12 commits
- PEGASUS-X (#18551) · 53e33e6f
  Jason Phang authored Sep 02, 2022
```
* PegasusX Initial commit

* rename

* pegasus X implementation

* pegx update

* pegx fix

* pegasus-x fixes

* pegx updates

* cleanup

* cleanup

* cleanup

* tests

* stylefixes

* Documentation update

* Model hub fix

* cleanup

* update

* update

* testfix

* Check fix

* tweaks for merging

* style

* style

* updates for pr

* style

* change pegasus-x repo
```
  53e33e6f
- Remove cached torch_extensions on CI runners (#18868) · ecdf9b06
  Yih-Dar authored Sep 02, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  ecdf9b06
- A script to download artifacts and perform CI error statistics (#18865) · 4e29b3f8
  Yih-Dar authored Sep 02, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  4e29b3f8
- Generate: validate `model_kwargs` on TF (and catch typos in generate arguments) (#18651) · 9196f48b
  Joao Gante authored Sep 02, 2022
  
  9196f48b
- postpone bnb load until it's needed (#18859) · c5be7cae
  Stas Bekman authored Sep 02, 2022
  
  c5be7cae
- Fix number of examples for iterable datasets in multiprocessing (#18856) · 9e346f74
  Sylvain Gugger authored Sep 02, 2022
```
* Fix number of examples for iterable datasets in multiprocessing

* Add stronger check
```
  9e346f74
- pin Slack SDK to 3.18.1 to avoid failing issue (#18869) · 0ab465a5
  Yih-Dar authored Sep 02, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  0ab465a5
- Clean up utils.hub using the latest from hf_hub (#18857) · 38c3cd52
  Sylvain Gugger authored Sep 02, 2022
```
* Clean up utils.hub using the latest from hf_hub

* Adapt test

* Address review comment

* Fix test
```
  38c3cd52
- Add OWL-ViT to the appropriate section (#18867) · 17981faf
  NielsRogge authored Sep 02, 2022
```
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
```
  17981faf
- [LayoutLM] Add clarification to docs (#18716) · c60dd98e
  NielsRogge authored Sep 02, 2022
```
* Add clarification

* Add another clarification

* Apply suggestion
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
```
  c60dd98e
- Fix naming issue with ImageToText pipeline (#18864) · 129d7329
  OlivierDehaene authored Sep 02, 2022
```
Co-authored-by: Olivier Dehaene <olivier@huggingface.co>
```
  129d7329
- if learning rate is a tensor, get item (float) (#18861) · 9b3eb810
  kmckiern authored Sep 02, 2022
  
  9b3eb810
01 Sep, 2022 16 commits

Split docs on modality (#18205) · 142e12af

Steven Liu authored Sep 01, 2022

* update

* 🖍 add missing files

* 📝 add nested sections

* 🖍 align titles with tasks

* oops

* remove quotes from titles

142e12af

Pin revision for LayoutLMForQuestionAnswering and TFLayoutLMForQuestionAnswering tests (#18854) · 23fab60b
Ankur Goyal authored Sep 01, 2022
```
* Pin revision for tests

* Fixup

* Update revision in models

* Shorten revisions
Co-authored-by: Ankur Goyal <ankur@impira.com>
```
23fab60b

Add Image To Text Generation pipeline (#18821) · ddb69e5a

OlivierDehaene authored Sep 01, 2022



* Add Image2TextGenerationPipeline to supported pipelines

* Add Flax and Tensorflow support

* Add Flax and Tensorflow small tests

* Add default model for Tensorflow

* Add docstring

* Fix doc style

* Add tiny models for pytorch and flax

* Remove flax from pipeline.
Fix tests

* Use ydshieh/vit-gpt2-coco-en as a default for both PyTorch and Tensorflow

* Fix Tensorflow support
Co-authored-by: Olivier Dehaene <olivier@huggingface.co>

ddb69e5a

Tie weights after preparing the model in run_clm (#18855) · c61f116b
Sylvain Gugger authored Sep 01, 2022

c61f116b

Cache results of is_torch_tpu_available() (#18777) · 1c381f36

Cody Yu authored Sep 01, 2022

* Cache results of is_torch_tpu_available()

* Update src/transformers/utils/import_utils.py

* Update src/transformers/utils/import_utils.py

1c381f36

TensorFlow MobileViT (#18555) · 954e18ab

Sayak Paul authored Sep 01, 2022



* initial implementation.

* add: working model till image classification.

* add: initial implementation that passes intg tests.
Co-authored-by: Amy <aeroberts4444@gmail.com>

* chore: formatting.

* add: tests (still breaking because of config mismatch).
Coo-authored-by: Yih <2521628+ydshieh@users.noreply.github.com>

* add: corrected tests and remaning changes.

* fix code style and repo consistency.

* address PR comments.

* address Amy's comments.

* chore: remove from_pt argument.

* chore: add full-stop.

* fix: TFLite model conversion in the doc.

* Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply formatting.

* chore: remove comments from the example block.

* remove identation in the example.
Co-authored-by: Amy <aeroberts4444@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

954e18ab

Adds timeout argument to training_args to avoid socket timeouts in DDP (#18562) · fe58929a

Gustavo de Rosa authored Sep 01, 2022

* chore(training_args): Adds support for timeout argument.

* fix(training_args): Passes make style through changes.

* fix(training_args): Removes wrong docstring sentence.

* fix(training_args): Fixes timeout not being JSON serializable.

* fix(training_args_sm): Also updates timeout to timeout_delta.

* fix(training_args): Fixes PR according to suggestions.

fe58929a

reflect max_new_tokens in `Seq2SeqTrainer` (#18786) · ab663b22

kumapo authored Sep 01, 2022

* reflect max_new_tokens in gen_kwargs to `trainer.generate()`

* reflect max_new_tokens in `Seq2SeqTrainer`

* remove unnecessary variable

* Trigger CI

* fix style

ab663b22

Minor typo in prose of model outputs documentation. (#18848) · f719c037
Pedro Cuenca authored Sep 01, 2022

f719c037

Pin rouge_score (#18247) · fafbb57d

Albert Villanova del Moral authored Sep 01, 2022

* Pin rouge_score

* Pin also in dependency_versions_table

* Update excluded versions

* Revert "Update excluded versions"

This reverts commit 0d0362df30a816108835f5c061272ee2bafec270.

* Revert "Revert "Update excluded versions""

This reverts commit 66c47af8a6baff253575631b0ba392e0354b6d56.

fafbb57d

add a script to get time info. from GA workflow jobs (#18822) · e7da38f5
Yih-Dar authored Sep 01, 2022
```
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
e7da38f5
Generate: smaller TF serving test (#18840) · 6e016634
Joao Gante authored Sep 01, 2022

6e016634

Delete `state_dict` to release memory as early as possible (#18832) · 563a8d58

Yih-Dar authored Sep 01, 2022


Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

563a8d58

Unpin fsspec (#18846) · a26c7523
Albert Villanova del Moral authored Sep 01, 2022

a26c7523
Create pipeline_tutorial.mdx german docs (#18625) · 359f7b4b
flozi00 authored Sep 01, 2022
```
* Create pipeline_tutorial.mdx

* Update _toctree.yml
```
359f7b4b

Owlvit memory leak fix (#18734) · 5d81a568

Alara Dirik authored Sep 01, 2022

* fix memory leak
* fix typos
* use singular last hidden state variable names
* eliminate double call to self.owlvit to return last hidden states
* eliminate 2nd call to self.vision_model in OwlViTModel

5d81a568

31 Aug, 2022 12 commits

Add security warning about the from_pretrained() method (#18801) · 80367cd1

lewtun authored Aug 31, 2022



* Add security warning about from_pretrained() method

* Add sentence about malware scanner
Co-authored-by: Julien Chaumond <julien@huggingface.co>

80367cd1

Add SegFormer ONNX support (#18006) · 7e7f7434

NielsRogge authored Aug 31, 2022



* Add ONNX support

* Make height and width dynamic axes
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>

7e7f7434

Improve Text Generation doc (#18788) · 89514f05

Ekagra Ranjan authored Sep 01, 2022



* fix args for bram search decoding in generation utils

* fix missing PAD token in gpt2

* add PAD EOS change to TF

* Update src/transformers/generation_tf_utils.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/generation_utils.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/generation_utils.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

89514f05

Add an option to `HfArgumentParser.parse_{dict,json_file}` to raise an... · 86387fe8

Felix Schneider authored Aug 31, 2022

Add an option to `HfArgumentParser.parse_{dict,json_file}` to raise an Exception when there extra keys (#18692)

* Update parser to track unneeded keys, off by default

* Fix formatting

* Fix docstrings and defaults in HfArgparser

* Fix formatting

86387fe8

Improve GPT2 doc (#18787) · f210e2a4

Ekagra Ranjan authored Aug 31, 2022

* Minor typo in GPT2 doc

* improve gpt2 label doc

* update dim of label in GPT2ForTokenClassification

* add change to tf

f210e2a4

Pin ffspec (#18837) · 74690b62
Sylvain Gugger authored Aug 31, 2022
```
* Pin ffspec

* Typo
```
74690b62

[DETR] Add num_channels attribute (#18714) · 3b6943e7

NielsRogge authored Aug 31, 2022



* Add num_channels attribute

* Fix code quality
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>

3b6943e7

fix bug: register_for_auto_class should be defined on TFPreTrainedModel... · 811c4c9f
Shu Takayama authored Aug 31, 2022
```
fix bug: register_for_auto_class should be defined on TFPreTrainedModel instead of TFSequenceSummary (#18607)
```
811c4c9f
Update location identification (#18834) · ee407024
Lysandre Debut authored Aug 31, 2022

ee407024
Warn on TPUs when the custom optimizer and model device are not the same (#18668) · e4910213
Zachary Mueller authored Aug 31, 2022
```
* Check optimizer for device on TPU

* Typo
```
e4910213

oob performance improvement for cpu DDP (#18595) · cdde85a0

Wang, Yi authored Aug 31, 2022



* oob performance improvement for cpu DDP
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* add is_psutil_available check
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

cdde85a0

Fix cost condition in DetrHungarianMatcher and YolosHungarianMatcher to allow zero-cost (#18647) · c3be98eb
Peter Jung authored Aug 31, 2022
```
* Fix loss condition in DetrHungarianMatcher

* Fix costs condition in YolosHungarianMatcher
```
c3be98eb