Commits · df165065c37329880f490025972f81b4daa6e5bd · chenpangpang / transformers

14 Sep, 2020 3 commits
- [s2s] distributed eval in one command (#7124) · 33d479d2
  Sam Shleifer authored Sep 14, 2020
  
  33d479d2
- [s2s distill] allow pegasus-12-12 (#7104) · 0fab3969
  Sam Shleifer authored Sep 14, 2020
  
  0fab3969
- [s2s] distributed eval cleanup (#7110) · de9e2979
  Sam Shleifer authored Sep 13, 2020
  
  de9e2979
13 Sep, 2020 1 commit
- [s2s] two stage run_distributed_eval.py (#7105) · e7f8d2ab
  Sam Shleifer authored Sep 13, 2020
  
  e7f8d2ab
12 Sep, 2020 1 commit
- [s2s] run_eval supports --prefix clarg. (#6953) · b76cb1c3
  Sam Shleifer authored Sep 12, 2020
  
  b76cb1c3
10 Sep, 2020 3 commits
- [wip/s2s] DistributedSortishSampler (#7056) · 77950c48
  Sam Shleifer authored Sep 10, 2020
  
  77950c48
- Fix CI with change of name of nlp (#7054) · 51448673
  Sylvain Gugger authored Sep 10, 2020
```
* nlp -> datasets

* More nlp -> datasets

* Woopsie

* More nlp -> datasets

* One last
```
  51448673
- [s2s] --eval_max_generate_length (#7018) · e9a2f772
  Sam Shleifer authored Sep 10, 2020
  
  e9a2f772
07 Sep, 2020 1 commit
- [s2s] warn if --fp16 for torch 1.6 (#6977) · ce37be9d
  Sam Shleifer authored Sep 06, 2020
  
  ce37be9d
04 Sep, 2020 2 commits
- [s2s] run_eval.py parses generate_kwargs (#6948) · a4fc0c80
  Sam Shleifer authored Sep 04, 2020
  
  a4fc0c80
- [s2s] distill: --normalize_hidden --supervise_forward (#6834) · 6078b120
  Sam Shleifer authored Sep 04, 2020
  
  6078b120
03 Sep, 2020 5 commits
- [s2s] support early stopping based on loss, rather than rouge (#6927) · e95d262f
  Sam Shleifer authored Sep 03, 2020
  
  e95d262f
- [s2s] use --eval_beams command line arg (#6926) · 207ed8cb
  Sam Shleifer authored Sep 03, 2020
  
  207ed8cb
- [s2s] allow task_specific_params=summarization_xsum (#6923) · 39ed68d5
  Sam Shleifer authored Sep 03, 2020
  
  39ed68d5
- [s2s]: script to convert pl checkpoints to hf checkpoints (#6911) · 5a318f07
  Sam Shleifer authored Sep 03, 2020
```
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
```
  5a318f07
- tweak tar command in readme (#6919) · b8e4906c
  brett koonce authored Sep 03, 2020
  
  b8e4906c
31 Aug, 2020 2 commits
- [s2s] command line args for faster val steps (#6833) · b9772897
  Sam Shleifer authored Aug 31, 2020
  
  b9772897
- Marian distill scripts + integration test (#6799) · 61b7ba93
  Sam Shleifer authored Aug 31, 2020
  
  61b7ba93
30 Aug, 2020 1 commit
- [s2s README] Add more dataset download instructions (#6737) · dfa10a41
  Sam Shleifer authored Aug 30, 2020
  
  dfa10a41
29 Aug, 2020 2 commits
- Pegasus finetune script: add --adafactor (#6811) · 0f58903b
  Sam Shleifer authored Aug 29, 2020
  
  0f58903b
- [s2s] round runtime in run_eval (#6798) · ac47458a
  Sam Shleifer authored Aug 29, 2020
  
  ac47458a
28 Aug, 2020 3 commits

[s2s] Test hub configs in self-scheduled CI (#6809) · 5ab21b07
Sam Shleifer authored Aug 28, 2020

5ab21b07

prepare_seq2seq_batch makes labels/ decoder_input_ids made later. (#6654) · 9336086a

Sam Shleifer authored Aug 28, 2020

* broken test

* batch parity

* tests pass

* boom boom

* boom boom

* split out bart tokenizer tests

* fix tests

* boom boom

* Fixed dataset bug

* Fix marian

* Undo extra

* Get marian working

* Fix t5 tok tests

* Test passing

* Cleanup

* better assert msg

* require torch

* Fix mbart tests

* undo extra decoder_attn_mask change

* Fix import

* pegasus tokenizer can ignore src_lang kwargs

* unused kwarg test cov

* boom boom

* add todo for pegasus issue

* cover one word translation edge case

* Cleanup

* doc

9336086a

PL: --adafactor option (#6776) · fb78a90d
Sam Shleifer authored Aug 27, 2020

fb78a90d

27 Aug, 2020 1 commit
- s2s distillation uses AutoModelForSeqToSeqLM (#6761) · 4bd7be9a
  Sam Shleifer authored Aug 26, 2020
  
  4bd7be9a
26 Aug, 2020 2 commits
- [s2s] run_eval.py QOL improvements and cleanup(#6746) · 61518e2d
  Sam Shleifer authored Aug 26, 2020
  
  61518e2d
- Black 20 release · a75c64d8
  Lysandre authored Aug 26, 2020
  
  a75c64d8
25 Aug, 2020 1 commit
- [s2s] round bleu, rouge to 4 digits (#6704) · 0344428f
  Sam Shleifer authored Aug 25, 2020
  
  0344428f
24 Aug, 2020 1 commit
- Update repo to isort v5 (#6686) · a5737779
  Sylvain Gugger authored Aug 24, 2020
```
* Run new isort

* More changes

* Update CI, CONTRIBUTING and benchmarks
```
  a5737779
17 Aug, 2020 3 commits
- allow spaces in bash args with "$@" (#6521) · d2da2cb2
  Sam Shleifer authored Aug 17, 2020
  
  d2da2cb2
- [lightning_base] fix s2s logging, only make train_loader once (#6404) · 84c265ff
  Sam Shleifer authored Aug 16, 2020
  
  84c265ff
- [s2s] docs, document desired filenames nicely (#6525) · 72add6c9
  Sam Shleifer authored Aug 16, 2020
  
  72add6c9
16 Aug, 2020 1 commit
- Fixes paths with spaces in seq2seq example (#6493) · 20601811
  Kyle Piira authored Aug 16, 2020
  
  20601811
13 Aug, 2020 1 commit
- Mult rouge by 100: standard units (#6359) · e92efcf7
  Sam Shleifer authored Aug 13, 2020
  
  e92efcf7
12 Aug, 2020 2 commits
- [s2s] add BartTranslationDistiller for distilling mBART (#6363) · f94a52cd
  Sam Shleifer authored Aug 12, 2020
  
  f94a52cd
- [test] replace capsys with the more refined CaptureStderr/CaptureStdout (#6422) · 87b35943
  Stas Bekman authored Aug 12, 2020
```
* replace capsys with the more refined CaptureStderr/CaptureStdout

* Update examples/seq2seq/test_seq2seq_examples.py
Co-authored-by: Sam Shleifer <sshleifer@gmail.com>
```
  87b35943
11 Aug, 2020 4 commits
- rename prepare_translation_batch -> prepare_seq2seq_batch (#6103) · be1520d3
  Sam Shleifer authored Aug 11, 2020
  
  be1520d3
- PegasusForConditionalGeneration (torch version) (#6340) · 66fa8cea
  Sam Shleifer authored Aug 11, 2020
```
Co-authored-by: Jingqing  Zhang <jingqing.zhang15@imperial.ac.uk>
```
  66fa8cea
- [s2s] wmt download script use less ram (#6405) · f6cb0f80
  Stas Bekman authored Aug 11, 2020
  
  f6cb0f80
- [s2s] Script to save wmt data to disk (#6403) · b9ecd92e
  Sam Shleifer authored Aug 10, 2020
  
  b9ecd92e