Commits · 9baa294c0d925896f267063f97e6c2666ef4d89f · gaoqiong / lm-evaluation-harness

12 May, 2022 1 commit
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness · 9baa294c
  jon-tow authored May 11, 2022
  
  9baa294c
11 May, 2022 5 commits
- Merge pull request #321 from EleutherAI/decontam-import-fix · e0396a4e
  Stella Biderman authored May 11, 2022
```
Decontam import fix
```
  e0396a4e
- Add bootstrap_iters kwarg · 4587b718
  Niklas Muennighoff authored May 11, 2022
  
  4587b718
- Format evaluator · 07ba1e68
  jon-tow authored May 11, 2022
  
  07ba1e68
- Fix undeclared identifier error · f81db68e
  jon-tow authored May 10, 2022
  
  f81db68e
- Fix `ModuleNotFoundError` in evaluator · 8d5b116c
  jon-tow authored May 10, 2022
  
  8d5b116c
03 May, 2022 5 commits
- Merge pull request #317 from EleutherAI/Mistobaan/add-pre-commit · a2cada5d
  Jonathan Tow authored May 03, 2022
```
Add pre-commit
```
  a2cada5d
- Update `task_guide` and add `pre-commit` dev dependency · 83507c4b
  jon-tow authored May 03, 2022
  
  83507c4b
- Revert `tests/testdata` changes and address flake8 issues · 8c997e53
  jon-tow authored May 03, 2022
  
  8c997e53
- fix codespell · d95a4333
  Fabrizio Milo authored May 02, 2022
  
  d95a4333
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
01 May, 2022 3 commits
- Merge pull request #301 from StephenHogg/task_doc · 7a038118
  Jonathan Tow authored May 01, 2022
```
Suggested updates for the task guide
```
  7a038118
- Merge branch 'master' into task_doc · 11f614b0
  Stella Biderman authored Apr 30, 2022
  
  11f614b0
- Merge pull request #261 from EleutherAI/researcher2 · e00d682f
  Jonathan Tow authored Apr 30, 2022
```
Update CLI options and introduce decontamination
```
  e00d682f
29 Apr, 2022 16 commits
- Merge pull request #315 from jon-tow/unpin-datasets · eb8163e9
  Stella Biderman authored Apr 29, 2022
```
Unpin `datasets`
```
  eb8163e9
- Merge pull request #316 from jon-tow/master · cf074822
  Stella Biderman authored Apr 29, 2022
```
Revert "Merge branch 'master' into master"
```
  cf074822
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
- Merge branch 'master' into master · 5fe7e2c0
  Stella Biderman authored Apr 29, 2022
  
  5fe7e2c0
- Unpin `datasets` · 73ca0545
  jon-tow authored Apr 29, 2022
  
  73ca0545
- Merge pull request #32 from bigscience-workshop/kkawamu1/gem_xsum · 37afce3b
  Jonathan Tow authored Apr 29, 2022
```
Remove stopping_criteria and set max_generation_length to 64
```
  37afce3b
- Merge pull request #31 from bigscience-workshop/max-gen-fix · f4600a9f
  Jonathan Tow authored Apr 29, 2022
```
Fix naming
```
  f4600a9f
- Fix naming · 7dd1ef95
  jon-tow authored Apr 29, 2022
  
  7dd1ef95
- Merge pull request #20 from JanKalo/master · 372ca6f5
  Stella Biderman authored Apr 29, 2022
```
Added bigscience-LAMA evaluation 
```
  372ca6f5
- Merge pull request #27 from bigscience-workshop/add_HuffPost · 2e0b659a
  Stella Biderman authored Apr 29, 2022
```
Add HuffPost 
```
  2e0b659a
- Fix max generation length · 9af73872
  Tian Yun authored Apr 29, 2022
  
  9af73872
- integrate HuffPost to EvalHarness · 2c165797
  KhalidAlt authored Apr 29, 2022
  
  2c165797
- Update lama.py · 49f117ed
  KhalidAlt authored Apr 29, 2022
```
set (has_test_docs) to true
```
  49f117ed
- Merge pull request #26 from bigscience-workshop/max-gen-fix · ad23a861
  Stella Biderman authored Apr 28, 2022
```
Fix max generation limit
```
  ad23a861
- Update lama.py · 674e0564
  KhalidAlt authored Apr 29, 2022
  
  674e0564
- Fix max generation limit · eda365f6
  jon-tow authored Apr 28, 2022
  
  eda365f6
28 Apr, 2022 10 commits
- Merge branch 'master' into master · 1444a36c
  KhalidAlt authored Apr 28, 2022
  
  1444a36c
- Update __init__.py · 13676905
  KhalidAlt authored Apr 28, 2022
  
  13676905
- Update __init__.py · 00903bc3
  KhalidAlt authored Apr 28, 2022
```
Add lama and bigscience lama
```
  00903bc3
- Merge branch 'add_lama' into master · 6559ba0f
  KhalidAlt authored Apr 28, 2022
  
  6559ba0f
- Merge pull request #309 from dirkgr/PytestUpdate · 14b8ec7e
  Stella Biderman authored Apr 28, 2022
```
Fixes for using lm_eval as a library
```
  14b8ec7e
- Merge pull request #25 from oskarvanderwal/master · 22155f7d
  Stella Biderman authored Apr 28, 2022
```
Adding CrowsPairs task for English and French
```
  22155f7d
- Update `task_guide.md` instructions for dev environ setup · e9f8f654
  jon-tow authored Apr 21, 2022
  
  e9f8f654
- Rename all `_load_doc`s to `_process_doc` · bc9f6fc5
  jon-tow authored Apr 21, 2022
  
  bc9f6fc5
- Rename bigsciencelama.py to lama.py · 0816eba0
  KhalidAlt authored Apr 28, 2022
```
change file name
```
  0816eba0
- Merge pull request #306 from jon-tow/add-swag · 827e2d51
  Stella Biderman authored Apr 28, 2022
```
Add `SWAG`
```
  827e2d51