Commits · 827e2d511baaee53ebf8dbc0b6308f83abf48252 · gaoqiong / lm-evaluation-harness

28 Apr, 2022 4 commits
- Merge pull request #306 from jon-tow/add-swag · 827e2d51
  Stella Biderman authored Apr 28, 2022
```
Add `SWAG`
```
  827e2d51
- Merge pull request #305 from jon-tow/add-triviaqa-dataset-features · 1da3d719
  Stella Biderman authored Apr 28, 2022
```
Add dataset features to `TriviaQA`
```
  1da3d719
- Merge pull request #308 from jon-tow/add-templates · 235f8d3f
  Stella Biderman authored Apr 28, 2022
```
Add templates and update docs
```
  235f8d3f
- Update CODEOWNERS · 23ddba77
  Stella Biderman authored Apr 28, 2022
  
  23ddba77
18 Apr, 2022 1 commit
- Add templates and update docs · a0fa0454
  jon-tow authored Apr 18, 2022
  
  a0fa0454
12 Apr, 2022 2 commits
- Add testdata · 9b6c45a8
  jon-tow authored Apr 12, 2022
  
  9b6c45a8
- Add `SWAG` · 80f3e064
  jon-tow authored Apr 12, 2022
  
  80f3e064
11 Apr, 2022 1 commit
- Add dataset features to `TriviaQA` · 70772cb2
  jon-tow authored Apr 11, 2022
  
  70772cb2
01 Apr, 2022 1 commit
- Merge pull request #300 from jon-tow/hf-dataset-refactor · 6caa0afd
  Leo Gao authored Apr 01, 2022
```
Refactor `Task` downloading to use `HuggingFace.datasets`
```
  6caa0afd
31 Mar, 2022 3 commits
- Fix docstring · 9434722c
  Jon Tow authored Mar 31, 2022
  
  9434722c
- Adopt `_process_doc` method · 39c8c87f
  Jon Tow authored Mar 31, 2022
  
  39c8c87f
- Add specific `load_dataset` args · d79a4389
  Jon Tow authored Mar 31, 2022
  
  d79a4389
19 Mar, 2022 2 commits
- Whitespace formatting · 4f8b99f6
  Jon Tow authored Mar 19, 2022
  
  4f8b99f6
- Revert `pile` coverage omit · ad164f36
  Jon Tow authored Mar 19, 2022
  
  ad164f36
18 Mar, 2022 5 commits
- Omit task coverage · daa1f436
  Jon Tow authored Mar 18, 2022
  
  daa1f436
- Fix dataset value feature · c2e32987
  Jon Tow authored Mar 18, 2022
  
  c2e32987
- Add custom `image`less `HeadQA` dataset · 897ae76d
  Jon Tow authored Mar 18, 2022
  
  897ae76d
- Fix training docs caching · 13317f8c
  Jon Tow authored Mar 18, 2022
  
  13317f8c
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
07 Mar, 2022 1 commit
- Bump version to 0.2.0 · 7064d6b9
  Leo Gao authored Mar 06, 2022
  
  7064d6b9
06 Mar, 2022 3 commits
- Merge pull request #296 from jon-tow/gsm8k-fix · fcaea0e3
  Leo Gao authored Mar 06, 2022
```
Add positional args to `gsm8k` `download_file`
```
  fcaea0e3
- Add positional args to `gsm8k` `download_file` · f91a70d6
  Jonathan Tow authored Mar 06, 2022
  
  f91a70d6
- Merge pull request #294 from jon-tow/asdiv-remove-fewshot-description · cec2fe23
  Leo Gao authored Mar 06, 2022
```
Remove `Asdiv` `fewshot_description` method
```
  cec2fe23
05 Mar, 2022 1 commit
- Remove `Asdiv` `fewshot-description` method · d14ab6d5
  Jonathan Tow authored Mar 05, 2022
  
  d14ab6d5
02 Mar, 2022 1 commit
- Merge pull request #292 from jon-tow/task-doc-update · 263eb48d
  Leo Gao authored Mar 01, 2022
```
Add citations and descriptions to all tasks
```
  263eb48d
28 Feb, 2022 4 commits
- Update `task_guide.md` for new citation structure · b82e1a87
  Jonathan Tow authored Feb 28, 2022
  
  b82e1a87
- Correct misspellings · 9e0b7102
  Jonathan Tow authored Feb 28, 2022
  
  9e0b7102
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
27 Feb, 2022 2 commits
- Merge pull request #291 from StephenHogg/check_integrity_docs · 663b781b
  Leo Gao authored Feb 27, 2022
```
Add comment to README explaining check integrity flag
```
  663b781b
- Update README.md · fff69d42
  Leo Gao authored Feb 27, 2022
  
  fff69d42
26 Feb, 2022 1 commit
- Add comment to README explaining check integrity flag · db1d67f6
  Stephen Hogg authored Feb 26, 2022
  
  db1d67f6
25 Feb, 2022 4 commits
- Merge pull request #290 from StephenHogg/check_integrity · 93cf95d0
  Leo Gao authored Feb 24, 2022
```
Add integrity check
```
  93cf95d0
- add flag · 40c1e05c
  Leo Gao authored Feb 24, 2022
  
  40c1e05c
- Change function signature so package root is always found from utils.py · 606b98f7
  Stephen Hogg authored Feb 25, 2022
  
  606b98f7
- Add integrity check · 4d8dde31
  Stephen Hogg authored Feb 25, 2022
  
  4d8dde31
22 Feb, 2022 2 commits
- Merge pull request #264 from StephenHogg/qasper · 3c37ea9c
  Leo Gao authored Feb 21, 2022
```
Add QASPER task
```
  3c37ea9c
- Don't create requests for TODO metrics · 815f165c
  Stephen Hogg authored Feb 22, 2022
  
  815f165c
21 Feb, 2022 2 commits
- Mark unanswerable as TODO · f7aaff08
  Stephen Hogg authored Feb 22, 2022
  
  f7aaff08
- Merge pull request #289 from jon-tow/gsm8k-testdata · 89905174
  Leo Gao authored Feb 20, 2022
```
Add `gsm8k` test data
```
  89905174