Commits · c203509d5b0f002a7833382a03ffe7802aa14e91 · chenpangpang / transformers

"...Speech/Tacotron2/tacotron2_common/audio_processing.py" did not exist on "0fc002dfc863089e33ea2dee33b0827046e4d174"

05 Mar, 2020 9 commits
- undo chg · c203509d
  sshleifer authored Mar 05, 2020
  
  c203509d
- tests pass · c36fdc88
  sshleifer authored Mar 05, 2020
  
  c36fdc88
- Updated notebook dependencies for Colab. · 7ac47bfe
  Morgan Funtowicz authored Mar 05, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
  7ac47bfe
- Fixing sentiment pipeline in 03-pipelines notebook. · be02176a
  Morgan Funtowicz authored Mar 05, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
  be02176a
- Add model cards for DeepPavlov models (#3138) · 8a2d9bc9
  Julien Chaumond authored Mar 05, 2020
```
* add empty model cards for every current DeepPavlov model

* fix: replace cyrillic `с` with `c`

* docs: add model cards for current DeepPavlov BERT models

* docs: add links for arXiv preprints
```
  8a2d9bc9
- Updating colab links in notebooks README. · 012cbdb0
  Morgan Funtowicz authored Mar 05, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
  012cbdb0
- Fix Colab links + install dependencies first. · 30624f70
  Morgan Funtowicz authored Mar 05, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
  30624f70
- make style · ff9e79ba
  Julien Chaumond authored Mar 04, 2020
  
  ff9e79ba
- Fix failing doc samples · 07a79db5
  Lysandre authored Mar 04, 2020
  
  07a79db5
04 Mar, 2020 19 commits

Merge pull request #3118 from patrickvonplaten/add_beam_search_to_generation_tf_2_0 · bdd3d0c7
Thomas Wolf authored Mar 04, 2020
```
Add beam search to generation tf 2 0
```
bdd3d0c7
[model_cards] Tag AR model languages · c440030e
Julien Chaumond authored Mar 04, 2020

c440030e
Merge pull request #3115 from gthb/fix-bogus-param-to-layer-init · 3b7f95a5
Thomas Wolf authored Mar 04, 2020
```
fix: passing config as Layer trainable param
```
3b7f95a5
Update notebook link and fix few working issues. · 1bca97ec
Morgan Funtowicz authored Mar 04, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
1bca97ec
Create README.md · 189113d8
Manuel Romero authored Mar 04, 2020

189113d8

[model_cards] Add card by @lvwerra · 76111a3d

Julien Chaumond authored Mar 04, 2020

(the current way to submit a model card to have it displayed on the website is to open a PR on the `transformers` repo itself)

Thanks for sharing!

76111a3d

[model_cards] Add card by @djstrong · a43c388a

Julien Chaumond authored Mar 04, 2020

(the current way to submit a model card to have it displayed on the website is to open a PR on the `transformers` repo itself)

Thanks for sharing!

a43c388a

Create README.md · ec60e0ae
Manuel Romero authored Mar 03, 2020

ec60e0ae
model cards for both aubmindlab/bert-base-arabert models (#3113) · 6a143bf2
Wissam Antoun authored Mar 04, 2020
```
* Added readme for AraBERTv0.1

* Added readme to AraBERT
```
6a143bf2
include tf gpt2 tests for attn mask and past variable (#3122) · 932eab94
Patrick von Platen authored Mar 04, 2020

932eab94
[doc] Fix link to how-to-train Colab · 256cbbc4
Julien Chaumond authored Mar 04, 2020

256cbbc4
rename variables named 'word' to 'token' in generate fn (#3119) · 006097f8
Patrick von Platen authored Mar 04, 2020
```
* fix conflits

* fixed naming bug

* make style
```
006097f8

Adding Docker images for transformers + notebooks (#3051) · 71c87119

Funtowicz Morgan authored Mar 04, 2020



* Added transformers-pytorch-cpu and gpu Docker images
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added automatic jupyter launch for Docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Move image from alpine to Ubuntu to align with NVidia container images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added TRANSFORMERS_VERSION argument to Dockerfile.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Pytorch-GPU based Docker image
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Tensorflow images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Use python 3.7 as Tensorflow doesnt provide 3.8 compatible wheel.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Remove double FROM instructions on transformers-pytorch-cpu image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added transformers-tensorflow-gpu Docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* use the correct ubuntu version for tensorflow-gpu
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added pipelines example notebook
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added transformers-cpu and transformers-gpu (including both PyTorch and TensorFlow) images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Docker images doesnt start jupyter notebook by default.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Tokenizers notebook
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Update images links
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Update Docker images to python 3.7.6 and transformers 2.5.1
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added 02-transformers notebook.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Trying to realign 02-transformers notebook ?
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Transformer image schema

* Some tweaks on tokenizers notebook

* Removed old notebooks.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Attempt to provide table of content for each notebooks
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Second attempt.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reintroduce transformer image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Keep trying
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* It's going to fly !
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Remaining of the Table of Content
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix inlined elements for the table of content
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removed anaconda dependencies for Docker images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removing notebooks ToC
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added LABEL to each docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removed old Dockerfile
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Directly use the context and include transformers from here.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reduce overall size of compiled Docker images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Install jupyter by default and use CMD for easier launching of the images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reduce number of layers in the images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added README.md for notebooks.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix notebooks link in README
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix some wording issues.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added blog notebooks too.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Addressing spelling errors in review comments.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
Co-authored-by: MOI Anthony <xn1t0x@gmail.com>

71c87119

correct beam search sampling · 7a89a3e4
Patrick von Platen authored Mar 04, 2020

7a89a3e4
make GPT2 and CTRL shape consistent between torch and TF · c4c4c999
Patrick von Platen authored Mar 04, 2020

c4c4c999
set redorder past sort dimension to its default · 2529b2d3
patrickvonplaten authored Mar 04, 2020

2529b2d3
added beam_search generation for tf 2.0 · 61fef6e9
patrickvonplaten authored Mar 04, 2020

61fef6e9
fix sklearn release circle ci [temporary] (#3123) · 34de670d
Patrick von Platen authored Mar 04, 2020

34de670d
fix beam_search behavior when sampling (#3106) · 6701fb78
Patrick von Platen authored Mar 04, 2020
```
* fix beam_search behavior when sampling

* delete print

* make correct style
```
6701fb78

03 Mar, 2020 9 commits

fix: passing config as Layer trainable param · b1116fd6
Gunnlaugur Thor Briem authored Mar 03, 2020
```
Lurking bugs discovered while working on other stuff.
```
b1116fd6
BartForSequenceClassification: fix num_labels, add test (#3110) · e9e6efdc
Sam Shleifer authored Mar 03, 2020

e9e6efdc

[ci] Re-run integration ground truth from fairseq · f631e01d

Julien Chaumond authored Mar 03, 2020

Adopted best practice set by @patrickvonplaten of commenting lines run on fairseq, for easy comparison

also see #3020

f631e01d

Summarization Examples: add Bart CNN Evaluation (#3082) · 5b396457

Sam Shleifer authored Mar 03, 2020

* Rename and improve example

* Add test

* slightly faster test

* style

* This breaks remy prolly

* shorter test string

* no slow

* newdir structure

* New tree

* Style

* shorter

* docs

* clean

* Attempt future import

* more import hax

5b396457

[Bart] dont call .forward (#3094) · 5c5af879
Sam Shleifer authored Mar 03, 2020

5c5af879
[model_cards] Fix incorrect path · a088d75e
Julien Chaumond authored Mar 03, 2020

a088d75e

Add generate() functionality to TF 2.0 (#3063) · 41341003

Patrick von Platen authored Mar 03, 2020

* add first copy past test to tf 2 generate

* add tf top_k_top_p_filter fn

* add generate function for TF

* add generate function for TF

* implemented generate for all models expect transfoXL

* implemented generate for all models expect transfoXL

* implemented generate for all models expect transfoXL

* make style

* change permission of test file to correct ones

* delete ipdb

* delete ipdb

* fix bug and finish simple gpt2 integration test

* clean test file

* clean test file

* make style

* make style

* make style

* make style

* change import style

* change import style

* make style

* make style

* add decorators

* add decorators

* fix tf ctrl bug dim => axis in TF

* make style

* make style

* refactored test file

* refactored test file

* take out test_torch_tf_conversion if nothing is defined

* take out test_torch_tf_conversion if nothing is defined

* remove useless files

* remove useless files

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* solve conflicts

* solve conflicts

* fix conflicts

* fix conflicts

* merge conflicts

* delete ipdb

* exposed top_k_top_p_filtering fns

* delete weirdly created w! file

* add comment to test tf common modeling

* fix conflicts

* fix conflicts

* make style

* merge conflicts

* make style

* change tf.tensor.shape to shape_list(tensor)

41341003

bert-base-arabic model card · b31f7150
ali safaya authored Mar 03, 2020

b31f7150
Don't crash if fine-tuned model doesn't end with a number (#3099) · c0c7ec34
Davide Fiocco authored Mar 03, 2020
```
That's the same fix applied in https://github.com/huggingface/transformers/issues/2258 , but for the GLUE example
```
c0c7ec34

02 Mar, 2020 3 commits
- [BART] to each its own config + make BART compatible w/ Pipelines · eec5ec80
  Julien Chaumond authored Mar 02, 2020
```
cc @sshleifer
```
  eec5ec80
- add models cards for camembert-base-fquad camembert-base-squad (#3089) · 6b1558ba
  Felix MIKAELIAN authored Mar 02, 2020
```
* add models cards for camembert-base-fquad camembert-base-squad

* typo fix
```
  6b1558ba
- TF GPU CI (#3085) · f169957d
  Julien Chaumond authored Mar 02, 2020
```
* debug env

* Restrict TF GPU memory

* Fixup

* One more test

* rm debug logs

* Fixup
```
  f169957d