Commits · cf074822dfe044103eef02ac285dd906dda29a7d · gaoqiong / lm-evaluation-harness

29 Apr, 2022 14 commits
- Merge pull request #316 from jon-tow/master · cf074822
  Stella Biderman authored Apr 29, 2022
```
Revert "Merge branch 'master' into master"
```
  cf074822
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
- Merge branch 'master' into master · 5fe7e2c0
  Stella Biderman authored Apr 29, 2022
  
  5fe7e2c0
- Merge pull request #32 from bigscience-workshop/kkawamu1/gem_xsum · 37afce3b
  Jonathan Tow authored Apr 29, 2022
```
Remove stopping_criteria and set max_generation_length to 64
```
  37afce3b
- Merge pull request #31 from bigscience-workshop/max-gen-fix · f4600a9f
  Jonathan Tow authored Apr 29, 2022
```
Fix naming
```
  f4600a9f
- Fix naming · 7dd1ef95
  jon-tow authored Apr 29, 2022
  
  7dd1ef95
- Merge pull request #20 from JanKalo/master · 372ca6f5
  Stella Biderman authored Apr 29, 2022
```
Added bigscience-LAMA evaluation 
```
  372ca6f5
- Merge pull request #27 from bigscience-workshop/add_HuffPost · 2e0b659a
  Stella Biderman authored Apr 29, 2022
```
Add HuffPost 
```
  2e0b659a
- Fix max generation length · 9af73872
  Tian Yun authored Apr 29, 2022
  
  9af73872
- integrate HuffPost to EvalHarness · 2c165797
  KhalidAlt authored Apr 29, 2022
  
  2c165797
- Update lama.py · 49f117ed
  KhalidAlt authored Apr 29, 2022
```
set (has_test_docs) to true
```
  49f117ed
- Merge pull request #26 from bigscience-workshop/max-gen-fix · ad23a861
  Stella Biderman authored Apr 28, 2022
```
Fix max generation limit
```
  ad23a861
- Update lama.py · 674e0564
  KhalidAlt authored Apr 29, 2022
  
  674e0564
- Fix max generation limit · eda365f6
  jon-tow authored Apr 28, 2022
  
  eda365f6
28 Apr, 2022 26 commits
- Merge branch 'master' into master · 1444a36c
  KhalidAlt authored Apr 28, 2022
  
  1444a36c
- Update __init__.py · 13676905
  KhalidAlt authored Apr 28, 2022
  
  13676905
- Update __init__.py · 00903bc3
  KhalidAlt authored Apr 28, 2022
```
Add lama and bigscience lama
```
  00903bc3
- Merge branch 'add_lama' into master · 6559ba0f
  KhalidAlt authored Apr 28, 2022
  
  6559ba0f
- Merge pull request #309 from dirkgr/PytestUpdate · 14b8ec7e
  Stella Biderman authored Apr 28, 2022
```
Fixes for using lm_eval as a library
```
  14b8ec7e
- Merge pull request #25 from oskarvanderwal/master · 22155f7d
  Stella Biderman authored Apr 28, 2022
```
Adding CrowsPairs task for English and French
```
  22155f7d
- Update `task_guide.md` instructions for dev environ setup · e9f8f654
  jon-tow authored Apr 21, 2022
  
  e9f8f654
- Rename all `_load_doc`s to `_process_doc` · bc9f6fc5
  jon-tow authored Apr 21, 2022
  
  bc9f6fc5
- Rename bigsciencelama.py to lama.py · 0816eba0
  KhalidAlt authored Apr 28, 2022
```
change file name
```
  0816eba0
- Merge pull request #306 from jon-tow/add-swag · 827e2d51
  Stella Biderman authored Apr 28, 2022
```
Add `SWAG`
```
  827e2d51
- Merge pull request #305 from jon-tow/add-triviaqa-dataset-features · 1da3d719
  Stella Biderman authored Apr 28, 2022
```
Add dataset features to `TriviaQA`
```
  1da3d719
- Merge pull request #308 from jon-tow/add-templates · 235f8d3f
  Stella Biderman authored Apr 28, 2022
```
Add templates and update docs
```
  235f8d3f
- Update CODEOWNERS · 23ddba77
  Stella Biderman authored Apr 28, 2022
  
  23ddba77
- Merge branch 'bigscience-workshop:master' into master · 073b0808
  Oskar van der Wal authored Apr 28, 2022
  
  073b0808
- Added CrowsPairs for English and French · 2d861a29
  Oskar authored Apr 28, 2022
  
  2d861a29
- Updated T0 and GPT-J · 29bff88d
  Tian Yun authored Apr 28, 2022
  
  29bff88d
- Update stopping criteria for few-shot · b62d1bec
  Tian Yun authored Apr 28, 2022
  
  b62d1bec
- Merge branch 'master' into master · 50d02961
  Stella Biderman authored Apr 28, 2022
  
  50d02961
- Merge branch 'master' into add_lama · 1e44199c
  Stella Biderman authored Apr 28, 2022
  
  1e44199c
- Modified stopping criteria for T5 and GPT-2 · 5e59320b
  Tian Yun authored Apr 28, 2022
  
  5e59320b
- comment unimplemented task · 235494f4
  KhalidAlt authored Apr 28, 2022
  
  235494f4
- add dataset description · 58abbac2
  KhalidAlt authored Apr 28, 2022
  
  58abbac2
- Merge branch 'master' of https://github.com/bigscience-workshop/lm-evaluation-harness · c46ff9e4
  Tian Yun authored Apr 28, 2022
  
  c46ff9e4
- Fixed generation trunction for GPT-2 and T5 · 6c86eb47
  Tian Yun authored Apr 28, 2022
  
  6c86eb47
- add lama task · 383318fe
  KhalidAlt authored Apr 28, 2022
  
  383318fe
- Merge pull request #21 from tomlimi/tomlimi/fix_fs_write_out · a963ab81
  Charles Lovering authored Apr 28, 2022
```
Fixed issue with write_out for datasets without a training split
```
  a963ab81