Commits · 9590f3664e278f2e320e70c883c3c5cdcbca1380 · gaoqiong / lm-evaluation-harness

09 Dec, 2021 2 commits
- Bump version to 0.1.0 · 9590f366
  Leo Gao authored Dec 08, 2021
  
  9590f366
- Update evaluator.py · c7ae6df1
  Leo Gao authored Dec 08, 2021
  
  c7ae6df1
05 Dec, 2021 3 commits
- Update test_gpt3.py · a6bb79b4
  Leo Gao authored Dec 05, 2021
  
  a6bb79b4
- Update test_gpt3.py · 01b98d2d
  Leo Gao authored Dec 05, 2021
  
  01b98d2d
- Get rid of get_token_logprobs · 7c011370
  Leo Gao authored Dec 05, 2021
  
  7c011370
01 Dec, 2021 1 commit
- Merge pull request #232 from zphang/lm_refactor_update1 · ae63eeb7
  Leo Gao authored Nov 30, 2021
```
Additional clean-up of LM Refactor
```
  ae63eeb7
29 Nov, 2021 3 commits
- Update req_type to request_type · 6b6e6d77
  Leo Gao authored Nov 28, 2021
  
  6b6e6d77
- Make everything request_type · 3b386db4
  Leo Gao authored Nov 28, 2021
  
  3b386db4
- Update base.py · 24fde4a6
  Leo Gao authored Nov 28, 2021
  
  24fde4a6
24 Nov, 2021 2 commits
- update GPT3 test data and more docs · 53f6bc34
  Jason Phang authored Nov 23, 2021
  
  53f6bc34
- Some refactor/clean-up, and GPT-3 update · 76ebb792
  Jason Phang authored Nov 23, 2021
  
  76ebb792
05 Nov, 2021 4 commits
- Less strict versioning for black · 91e7f182
  Leo Gao authored Nov 05, 2021
  
  91e7f182
- Add imports and fix comment · 2ff1f5a2
  Leo Gao authored Nov 05, 2021
  
  2ff1f5a2
- Switch gpt3 to BaseLM · 8ef7a515
  Leo Gao authored Nov 05, 2021
  
  8ef7a515
- Merge TokenizedLM and TorchLM into BaseLM · fea936e6
  Leo Gao authored Nov 05, 2021
  
  fea936e6
11 Oct, 2021 1 commit
- Refactor LM organization for more reuse · 7f24a08b
  Leo Gao authored Oct 11, 2021
  
  7f24a08b
06 Oct, 2021 1 commit
- Make gpt2 a little more tokenizer agnostic · e5066c69
  Leo Gao authored Oct 05, 2021
  
  e5066c69
01 Oct, 2021 1 commit
- UPdate cost estimate · 7f8d6676
  Leo Gao authored Oct 01, 2021
  
  7f8d6676
30 Sep, 2021 1 commit
- Improve interface and upgrade results dict format · 7a058d69
  Leo Gao authored Sep 30, 2021
  
  7a058d69
29 Sep, 2021 3 commits
- add support for HF revision · b569f483
  Leo Gao authored Sep 29, 2021
  
  b569f483
- Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness · 3b81a361
  Leo Gao authored Sep 28, 2021
  
  3b81a361
- gpt2: fix bad multi gpu behavior and typecheck inputs · 7f7b717d
  Leo Gao authored Sep 28, 2021
  
  7f7b717d
15 Sep, 2021 1 commit
- Create CITATION.bib · dc937d4b
  Stella Biderman authored Sep 14, 2021
  
  dc937d4b
08 Sep, 2021 1 commit
- Update README.md · 69a2b49b
  Leo Gao authored Sep 08, 2021
  
  69a2b49b
06 Sep, 2021 2 commits
- Update README.md · e037ef0a
  Leo Gao authored Sep 06, 2021
  
  e037ef0a
- Update README.md · 8c79ccc0
  Leo Gao authored Sep 06, 2021
  
  8c79ccc0
03 Sep, 2021 2 commits
- Merge pull request #216 from EleutherAI/fix_download_if_exists · feee4ed4
  sdtblck authored Sep 03, 2021
```
fix file download for existing files
```
  feee4ed4
- fix file download for existing files · 031677b6
  Samuel Weinbach authored Sep 03, 2021
  
  031677b6
02 Sep, 2021 1 commit
- Update README.md · 49dc058d
  Leo Gao authored Sep 01, 2021
  
  49dc058d
01 Sep, 2021 4 commits
- Rename package · 72d39b77
  Leo Gao authored Sep 01, 2021
  
  72d39b77
- Add MT lambada multilingual testdata · b50b1ffd
  Leo Gao authored Sep 01, 2021
  
  b50b1ffd
- Merge pull request #215 from EleutherAI/sdtblck-patch-1 · 28fa2ddd
  Leo Gao authored Sep 01, 2021
```
Fix lambada multilingual tasks
```
  28fa2ddd
- Fix lambada multilingual tasks · 754f1f24
  sdtblck authored Sep 01, 2021
```
the old task constructor was making everything spanish
```
  754f1f24
31 Aug, 2021 2 commits
- Move jieba and nagisa imports into their respective functions · 9d46382b
  Leo Gao authored Aug 31, 2021
  
  9d46382b
- Merge pull request #204 from EleutherAI/lambada-multilingual · 13710677
  Leo Gao authored Aug 31, 2021
```
Add multlingual lambada 
```
  13710677
28 Aug, 2021 1 commit
- triviaqa OOM fix · 52f270dc
  Leo Gao authored Aug 27, 2021
  
  52f270dc
27 Aug, 2021 2 commits
- Add zh/ja v1 data · e4766cd7
  Leo Gao authored Aug 26, 2021
  
  e4766cd7
- evaloator: take min bootstrap steps for blue/chrf/ter · dd3b4f7a
  Leo Gao authored Aug 26, 2021
  
  dd3b4f7a
26 Aug, 2021 2 commits
- Merge pull request #214 from Muennighoff/tokenization · d67c77be
  Leo Gao authored Aug 26, 2021
```
Add space tokenization for JA/ZH
```
  d67c77be
- Merge pull request #213 from silentv0x/master · 4d2c1522
  Leo Gao authored Aug 26, 2021
```
Fixes DROP implementation
```
  4d2c1522