Commits · 146c521235ca057570cac4c1fc3f884ac464e580 · chenpangpang / transformers

"...lm-evaluation-harness.git" did not exist on "6eac00565e3fdc2741c1048960f2e16dd308222d"

05 Mar, 2020 20 commits
- Merge branch 'master' into add_models_special_tokens_to_specific_configs · 146c5212
  Lysandre Debut authored Mar 05, 2020
  
  146c5212
- Pass kwargs to configuration (#3147) · b623ddc0
  Lysandre Debut authored Mar 05, 2020
```
* Pass kwargs to configuration

* Setter

* test
```
  b623ddc0
- Correct missing keys + test (#3143) · 0001d056
  Lysandre Debut authored Mar 05, 2020
  
  0001d056
- Merge pull request #3145 from sshleifer/bartfp16 · 1741d740
  Thomas Wolf authored Mar 05, 2020
```
[Bart] FP16 Support
```
  1741d740
- Merge pull request #3135 from patrickvonplaten/refactor_beam_search_generate · bbabbc16
  Thomas Wolf authored Mar 05, 2020
```
Refactoring and bug fixing beam search generate
```
  bbabbc16
- remove newline · 14d40584
  sshleifer authored Mar 05, 2020
  
  14d40584
- cleanup deltas · 1360daca
  sshleifer authored Mar 05, 2020
  
  1360daca
- no ipdb · 810079de
  sshleifer authored Mar 05, 2020
  
  810079de
- undo chg · c203509d
  sshleifer authored Mar 05, 2020
  
  c203509d
- tests pass · c36fdc88
  sshleifer authored Mar 05, 2020
  
  c36fdc88
- Updated notebook dependencies for Colab. · 7ac47bfe
  Morgan Funtowicz authored Mar 05, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
  7ac47bfe
- Fixing sentiment pipeline in 03-pipelines notebook. · be02176a
  Morgan Funtowicz authored Mar 05, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
  be02176a
- Add model cards for DeepPavlov models (#3138) · 8a2d9bc9
  Julien Chaumond authored Mar 05, 2020
```
* add empty model cards for every current DeepPavlov model

* fix: replace cyrillic `с` with `c`

* docs: add model cards for current DeepPavlov BERT models

* docs: add links for arXiv preprints
```
  8a2d9bc9
- Updating colab links in notebooks README. · 012cbdb0
  Morgan Funtowicz authored Mar 05, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
  012cbdb0
- uncomment expression · e33ed12c
  Patrick von Platen authored Mar 05, 2020
  
  e33ed12c
- remove ipdb · 4220fd52
  Patrick von Platen authored Mar 05, 2020
  
  4220fd52
- refactoring and bug fixing beam search generate · c47394b0
  Patrick von Platen authored Mar 05, 2020
  
  c47394b0
- Fix Colab links + install dependencies first. · 30624f70
  Morgan Funtowicz authored Mar 05, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
  30624f70
- make style · ff9e79ba
  Julien Chaumond authored Mar 04, 2020
  
  ff9e79ba
- Fix failing doc samples · 07a79db5
  Lysandre authored Mar 04, 2020
  
  07a79db5
04 Mar, 2020 19 commits

Merge pull request #3118 from patrickvonplaten/add_beam_search_to_generation_tf_2_0 · bdd3d0c7
Thomas Wolf authored Mar 04, 2020
```
Add beam search to generation tf 2 0
```
bdd3d0c7
[model_cards] Tag AR model languages · c440030e
Julien Chaumond authored Mar 04, 2020

c440030e
Merge pull request #3115 from gthb/fix-bogus-param-to-layer-init · 3b7f95a5
Thomas Wolf authored Mar 04, 2020
```
fix: passing config as Layer trainable param
```
3b7f95a5
Update notebook link and fix few working issues. · 1bca97ec
Morgan Funtowicz authored Mar 04, 2020
```
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
```
1bca97ec
Create README.md · 189113d8
Manuel Romero authored Mar 04, 2020

189113d8

[model_cards] Add card by @lvwerra · 76111a3d

Julien Chaumond authored Mar 04, 2020

(the current way to submit a model card to have it displayed on the website is to open a PR on the `transformers` repo itself)

Thanks for sharing!

76111a3d

[model_cards] Add card by @djstrong · a43c388a

Julien Chaumond authored Mar 04, 2020

(the current way to submit a model card to have it displayed on the website is to open a PR on the `transformers` repo itself)

Thanks for sharing!

a43c388a

Create README.md · ec60e0ae
Manuel Romero authored Mar 03, 2020

ec60e0ae
model cards for both aubmindlab/bert-base-arabert models (#3113) · 6a143bf2
Wissam Antoun authored Mar 04, 2020
```
* Added readme for AraBERTv0.1

* Added readme to AraBERT
```
6a143bf2
include tf gpt2 tests for attn mask and past variable (#3122) · 932eab94
Patrick von Platen authored Mar 04, 2020

932eab94
[doc] Fix link to how-to-train Colab · 256cbbc4
Julien Chaumond authored Mar 04, 2020

256cbbc4
rename variables named 'word' to 'token' in generate fn (#3119) · 006097f8
Patrick von Platen authored Mar 04, 2020
```
* fix conflits

* fixed naming bug

* make style
```
006097f8

Adding Docker images for transformers + notebooks (#3051) · 71c87119

Funtowicz Morgan authored Mar 04, 2020



* Added transformers-pytorch-cpu and gpu Docker images
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added automatic jupyter launch for Docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Move image from alpine to Ubuntu to align with NVidia container images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added TRANSFORMERS_VERSION argument to Dockerfile.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Pytorch-GPU based Docker image
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Tensorflow images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Use python 3.7 as Tensorflow doesnt provide 3.8 compatible wheel.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Remove double FROM instructions on transformers-pytorch-cpu image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added transformers-tensorflow-gpu Docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* use the correct ubuntu version for tensorflow-gpu
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added pipelines example notebook
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added transformers-cpu and transformers-gpu (including both PyTorch and TensorFlow) images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Docker images doesnt start jupyter notebook by default.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Tokenizers notebook
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Update images links
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Update Docker images to python 3.7.6 and transformers 2.5.1
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added 02-transformers notebook.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Trying to realign 02-transformers notebook ?
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added Transformer image schema

* Some tweaks on tokenizers notebook

* Removed old notebooks.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Attempt to provide table of content for each notebooks
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Second attempt.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reintroduce transformer image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Keep trying
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* It's going to fly !
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Remaining of the Table of Content
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix inlined elements for the table of content
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removed anaconda dependencies for Docker images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removing notebooks ToC
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added LABEL to each docker image.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Removed old Dockerfile
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Directly use the context and include transformers from here.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reduce overall size of compiled Docker images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Install jupyter by default and use CMD for easier launching of the images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Reduce number of layers in the images.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added README.md for notebooks.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix notebooks link in README
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix some wording issues.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Added blog notebooks too.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Addressing spelling errors in review comments.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
Co-authored-by: MOI Anthony <xn1t0x@gmail.com>

71c87119

correct beam search sampling · 7a89a3e4
Patrick von Platen authored Mar 04, 2020

7a89a3e4
make GPT2 and CTRL shape consistent between torch and TF · c4c4c999
Patrick von Platen authored Mar 04, 2020

c4c4c999
set redorder past sort dimension to its default · 2529b2d3
patrickvonplaten authored Mar 04, 2020

2529b2d3
added beam_search generation for tf 2.0 · 61fef6e9
patrickvonplaten authored Mar 04, 2020

61fef6e9
fix sklearn release circle ci [temporary] (#3123) · 34de670d
Patrick von Platen authored Mar 04, 2020

34de670d
fix beam_search behavior when sampling (#3106) · 6701fb78
Patrick von Platen authored Mar 04, 2020
```
* fix beam_search behavior when sampling

* delete print

* make correct style
```
6701fb78

03 Mar, 2020 1 commit
- fix: passing config as Layer trainable param · b1116fd6
  Gunnlaugur Thor Briem authored Mar 03, 2020
```
Lurking bugs discovered while working on other stuff.
```
  b1116fd6