Commits · b67aec37cf047f4daae243b0d26f3be910daca5e · gaoqiong / lm-evaluation-harness

11 Oct, 2021 6 commits
- Update README.md · b67aec37
  Leo Gao authored Oct 11, 2021
  
  b67aec37
- Merge pull request #181 from jon-tow/task-guide · 06d9be66
  Leo Gao authored Oct 11, 2021
```
Add `Task` implementation guide
```
  06d9be66
- Fix spacing issue · fab2a6d8
  Jonathan Tow authored Oct 11, 2021
  
  fab2a6d8
- Re-order sections and adjust header structure · de7d6614
  Jonathan Tow authored Oct 11, 2021
  
  de7d6614
- Update task-guide.md · a5541c02
  Leo Gao authored Oct 11, 2021
  
  a5541c02
- Update task-guide.md · cf8da970
  Leo Gao authored Oct 11, 2021
  
  cf8da970
07 Oct, 2021 2 commits
- Merge pull request #219 from jon-tow/truthfulqa · 33a94c54
  Leo Gao authored Oct 06, 2021
```
Implement `TruthfulQA`
```
  33a94c54
- Add underscores to metrics · 85ffb7fc
  Leo Gao authored Oct 06, 2021
  
  85ffb7fc
06 Oct, 2021 3 commits
- Add truthfulqa test data · 0538d4c9
  Leo Gao authored Oct 06, 2021
  
  0538d4c9
- Adhere to spacing convention · dd59b0ef
  Jonathan Tow authored Oct 06, 2021
  
  dd59b0ef
- Make gpt2 a little more tokenizer agnostic · e5066c69
  Leo Gao authored Oct 05, 2021
  
  e5066c69
01 Oct, 2021 1 commit
- UPdate cost estimate · 7f8d6676
  Leo Gao authored Oct 01, 2021
  
  7f8d6676
30 Sep, 2021 1 commit
- Improve interface and upgrade results dict format · 7a058d69
  Leo Gao authored Sep 30, 2021
  
  7a058d69
29 Sep, 2021 3 commits
- add support for HF revision · b569f483
  Leo Gao authored Sep 29, 2021
  
  b569f483
- Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness · 3b81a361
  Leo Gao authored Sep 28, 2021
  
  3b81a361
- gpt2: fix bad multi gpu behavior and typecheck inputs · 7f7b717d
  Leo Gao authored Sep 28, 2021
  
  7f7b717d
25 Sep, 2021 1 commit
- Implement `TruthfulQA` · 17c47812
  Jonathan Tow authored Sep 24, 2021
  
  17c47812
17 Sep, 2021 3 commits
- Merge branch 'task-guide' of https://github.com/jon-tow/lm-evaluation-harness into task-guide · 3b11c191
  Jonathan Tow authored Sep 17, 2021
  
  3b11c191
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into task-guide · 4d147bdd
  Jonathan Tow authored Sep 17, 2021
  
  4d147bdd
- fix up some wording · 011cc891
  Jonathan Tow authored Sep 17, 2021
  
  011cc891
16 Sep, 2021 1 commit
- Add missing colon to function call · f299be8f
  Jonathan Tow authored Sep 15, 2021
  
  f299be8f
15 Sep, 2021 1 commit
- Create CITATION.bib · dc937d4b
  Stella Biderman authored Sep 14, 2021
  
  dc937d4b
08 Sep, 2021 1 commit
- Update README.md · 69a2b49b
  Leo Gao authored Sep 08, 2021
  
  69a2b49b
06 Sep, 2021 2 commits
- Update README.md · e037ef0a
  Leo Gao authored Sep 06, 2021
  
  e037ef0a
- Update README.md · 8c79ccc0
  Leo Gao authored Sep 06, 2021
  
  8c79ccc0
03 Sep, 2021 2 commits
- Merge pull request #216 from EleutherAI/fix_download_if_exists · feee4ed4
  sdtblck authored Sep 03, 2021
```
fix file download for existing files
```
  feee4ed4
- fix file download for existing files · 031677b6
  Samuel Weinbach authored Sep 03, 2021
  
  031677b6
02 Sep, 2021 1 commit
- Update README.md · 49dc058d
  Leo Gao authored Sep 01, 2021
  
  49dc058d
01 Sep, 2021 4 commits
- Rename package · 72d39b77
  Leo Gao authored Sep 01, 2021
  
  72d39b77
- Add MT lambada multilingual testdata · b50b1ffd
  Leo Gao authored Sep 01, 2021
  
  b50b1ffd
- Merge pull request #215 from EleutherAI/sdtblck-patch-1 · 28fa2ddd
  Leo Gao authored Sep 01, 2021
```
Fix lambada multilingual tasks
```
  28fa2ddd
- Fix lambada multilingual tasks · 754f1f24
  sdtblck authored Sep 01, 2021
```
the old task constructor was making everything spanish
```
  754f1f24
31 Aug, 2021 2 commits
- Move jieba and nagisa imports into their respective functions · 9d46382b
  Leo Gao authored Aug 31, 2021
  
  9d46382b
- Merge pull request #204 from EleutherAI/lambada-multilingual · 13710677
  Leo Gao authored Aug 31, 2021
```
Add multlingual lambada 
```
  13710677
28 Aug, 2021 1 commit
- triviaqa OOM fix · 52f270dc
  Leo Gao authored Aug 27, 2021
  
  52f270dc
27 Aug, 2021 2 commits
- Add zh/ja v1 data · e4766cd7
  Leo Gao authored Aug 26, 2021
  
  e4766cd7
- evaloator: take min bootstrap steps for blue/chrf/ter · dd3b4f7a
  Leo Gao authored Aug 26, 2021
  
  dd3b4f7a
26 Aug, 2021 3 commits
- Merge pull request #214 from Muennighoff/tokenization · d67c77be
  Leo Gao authored Aug 26, 2021
```
Add space tokenization for JA/ZH
```
  d67c77be
- Merge pull request #213 from silentv0x/master · 4d2c1522
  Leo Gao authored Aug 26, 2021
```
Fixes DROP implementation
```
  4d2c1522
- evaluator: fix bleu/chrf/ter taking forever · 82ec4f53
  Leo Gao authored Aug 26, 2021
  
  82ec4f53