Commits · 2e0b659a9ead8a862cbf321d8294d40e4e62153c · gaoqiong / lm-evaluation-harness

29 Apr, 2022 5 commits
- Merge pull request #27 from bigscience-workshop/add_HuffPost · 2e0b659a
  Stella Biderman authored Apr 29, 2022
```
Add HuffPost 
```
  2e0b659a
- Fix max generation length · 9af73872
  Tian Yun authored Apr 29, 2022
  
  9af73872
- integrate HuffPost to EvalHarness · 2c165797
  KhalidAlt authored Apr 29, 2022
  
  2c165797
- Merge pull request #26 from bigscience-workshop/max-gen-fix · ad23a861
  Stella Biderman authored Apr 28, 2022
```
Fix max generation limit
```
  ad23a861
- Fix max generation limit · eda365f6
  jon-tow authored Apr 28, 2022
  
  eda365f6
28 Apr, 2022 35 commits
- Merge pull request #25 from oskarvanderwal/master · 22155f7d
  Stella Biderman authored Apr 28, 2022
```
Adding CrowsPairs task for English and French
```
  22155f7d
- Merge branch 'bigscience-workshop:master' into master · 073b0808
  Oskar van der Wal authored Apr 28, 2022
  
  073b0808
- Added CrowsPairs for English and French · 2d861a29
  Oskar authored Apr 28, 2022
  
  2d861a29
- Updated T0 and GPT-J · 29bff88d
  Tian Yun authored Apr 28, 2022
  
  29bff88d
- Update stopping criteria for few-shot · b62d1bec
  Tian Yun authored Apr 28, 2022
  
  b62d1bec
- Modified stopping criteria for T5 and GPT-2 · 5e59320b
  Tian Yun authored Apr 28, 2022
  
  5e59320b
- Merge branch 'master' of https://github.com/bigscience-workshop/lm-evaluation-harness · c46ff9e4
  Tian Yun authored Apr 28, 2022
  
  c46ff9e4
- Fixed generation trunction for GPT-2 and T5 · 6c86eb47
  Tian Yun authored Apr 28, 2022
  
  6c86eb47
- Merge pull request #21 from tomlimi/tomlimi/fix_fs_write_out · a963ab81
  Charles Lovering authored Apr 28, 2022
```
Fixed issue with write_out for datasets without a training split
```
  a963ab81
- Merge pull request #22 from bigscience-workshop/add-axg · 256de63b
  Charles Lovering authored Apr 28, 2022
```
Add `axg` and `axb` to SuperGLUE
```
  256de63b
- Add `axg` and `axb` to `super_glue` · 10492f4b
  jon-tow authored Apr 28, 2022
  
  10492f4b
- Merge pull request #17 from tomlimi/tomlimi/gender_bias · 449905de
  Charles Lovering authored Apr 28, 2022
```
WinoBias support added
```
  449905de
- Merge branch 'master' into tomlimi/gender_bias · 44e1ddb2
  Charles Lovering authored Apr 28, 2022
  
  44e1ddb2
- Merge pull request #19 from kasnerz/kasnerz/generation_tasks · 9d60dd76
  Charles Lovering authored Apr 28, 2022
```
Add E2E NLG Cleaned, update required Transformers version
```
  9d60dd76
- Merge branch 'master' into kasnerz/generation_tasks · 57737691
  Charles Lovering authored Apr 28, 2022
  
  57737691
- Merge pull request #16 from jordiclive/webnlg_challenge · d47f4534
  Charles Lovering authored Apr 28, 2022
```
adding WebNLG challenge sets
```
  d47f4534
- Merge pull request #13 from Shashi456/mlsum · c166e269
  Charles Lovering authored Apr 28, 2022
```
Fix tasks for GEM/mlsum
```
  c166e269
- Merge pull request #18 from jordiclive/simplification · 966b70ea
  Charles Lovering authored Apr 28, 2022
```
GEM Simplification
```
  966b70ea
- e2e_nlg_cleaned: Disable stopping criteria · 4be48911
  Zdenek Kasner authored Apr 28, 2022
  
  4be48911
- Fixed few-shot context generation or datasets without a training split · 49f0699c
  tomlimi authored Apr 28, 2022
  
  49f0699c
- e2e_nlg_cleaned: Update stopping criteria to "\n\n", exclude an accuracy-based prompt · 6588bc74
  Zdenek Kasner authored Apr 28, 2022
  
  6588bc74
- Merge remote-tracking branch 'origin/master' into kasnerz/generation_tasks · b7f070d8
  Zdenek Kasner authored Apr 28, 2022
  
  b7f070d8
- add docstring · ec80b255
  jordiclive authored Apr 28, 2022
  
  ec80b255
- GEM Simplification · 8cd91624
  jordiclive authored Apr 28, 2022
  
  8cd91624
- adding challenge sets · d42d5423
  jordiclive authored Apr 28, 2022
  
  d42d5423
- Remove custom max_length method · 9aba053a
  Zdenek Kasner authored Apr 28, 2022
  
  9aba053a
- Revert changes in base.py · 5a62765b
  Zdenek Kasner authored Apr 28, 2022
  
  5a62765b
- WinoBias support added · 7010e452
  tomlimi authored Apr 28, 2022
  
  7010e452
- Merge pull request #15 from bigscience-workshop/update-mlsum-task-name · 9cd70235
  Jonathan Tow authored Apr 28, 2022
```
Fix `mlsum` task names after split update
```
  9cd70235
- Fix `mlsum` task names after split update · 22ea032f
  jon-tow authored Apr 28, 2022
  
  22ea032f
- Merge pull request #14 from bigscience-workshop/fix-gpt-j · efd319b3
  Jonathan Tow authored Apr 28, 2022
```
Add `eot_token` property to gpt-j
```
  efd319b3
- Add `eot_token` property to gpt-j · 32d0658c
  jon-tow authored Apr 28, 2022
  
  32d0658c
- Merge branch 'bigscience-workshop:master' into mlsum · 0a720fc5
  Pawan Sasanka Ammanamanchi authored Apr 28, 2022
  
  0a720fc5
- Fix functions · a80d78db
  Shashi456 authored Apr 28, 2022
  
  a80d78db
- Merge pull request #5 from Shashi456/mlsum · f65e196e
  Jonathan Tow authored Apr 28, 2022
```
Add MLsum Tasks
```
  f65e196e