Commits · 31ed1c2a62655d1df44055d12a0faac50de1c498 · gaoqiong / lm-evaluation-harness

19 Aug, 2023 2 commits
- add branch wildcard; pytest verbosity++ in case failure · 31ed1c2a
  baberabb authored Aug 19, 2023
  
  31ed1c2a
- get _RES from CI and change atol to 0.0001 · ac290ce8
  baberabb authored Aug 19, 2023
  
  ac290ce8
17 Aug, 2023 11 commits
- delete pull_request.yml · a004fdc0
  baberabb authored Aug 17, 2023
  
  a004fdc0
- consolidated precommit to linter · 9fc9fd02
  baberabb authored Aug 17, 2023
  
  9fc9fd02
- added indices equality check · da77b216
  baberabb authored Aug 17, 2023
  
  da77b216
- change logliklihood atol to 1e-2 · 72bb97ca
  baberabb authored Aug 17, 2023
  
  72bb97ca
- fixup! added tolerance for likelihood, rolling · 91a06081
  baberabb authored Aug 17, 2023
  
  91a06081
- added tolerance for likelihood, rolling · dbbc613f
  baberabb authored Aug 17, 2023
  
  dbbc613f
- added pip cache to CI · b9df9fb4
  baberabb authored Aug 17, 2023
  
  b9df9fb4
- Merge remote-tracking branch 'origin/big-refactor' into big-refactor_hgtest · c2e76e79
  baberabb authored Aug 17, 2023
  
  c2e76e79
- Merge pull request #788 from EleutherAI/fix-perspective-apikey · 1c5a73c9
  Lintang Sutawika authored Aug 17, 2023
```
[Refactor] Don't always require Perspective API key to run 
```
  1c5a73c9
- added hf model test · f0aa2c7b
  baberabb authored Aug 17, 2023
  
  f0aa2c7b
- don't exit if RTP api key not set · 197940f7
  haileyschoelkopf authored Aug 17, 2023
  
  197940f7
16 Aug, 2023 12 commits
- Merge pull request #757 from EleutherAI/add-readme · 759da8d5
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] Add README.md
```
  759da8d5
- Merge branch 'big-refactor' into add-readme · c05a5ad4
  Lintang Sutawika authored Aug 16, 2023
  
  c05a5ad4
- Merge pull request #786 from EleutherAI/fix-doc_to_target · 73912efb
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] fix doc_to_target processing
```
  73912efb
- raise SystemExit 0 · 13f84b83
  lintangsutawika authored Aug 16, 2023
  
  13f84b83
- changed raise variable · 2fcd4298
  lintangsutawika authored Aug 16, 2023
  
  2fcd4298
- Merge pull request #782 from EleutherAI/truthfulqa · e8825ef6
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] Truthfulqa
```
  e8825ef6
- Update utils.py · 5b4f175f
  Lintang Sutawika authored Aug 16, 2023
  
  5b4f175f
- Merge pull request #783 from EleutherAI/mctaco · d53a81b0
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] MC Taco
```
  d53a81b0
- reformat · 579c9db9
  lintangsutawika authored Aug 16, 2023
  
  579c9db9
- change process to not require googleapi library · 60007dcf
  lintangsutawika authored Aug 16, 2023
  
  60007dcf
- reformat · d6030e12
  lintangsutawika authored Aug 16, 2023
  
  d6030e12
- fix doc_to_target processing · db37024b
  lintangsutawika authored Aug 16, 2023
  
  db37024b
15 Aug, 2023 15 commits
- update readme docs · da8af971
  lintangsutawika authored Aug 15, 2023
  
  da8af971
- add mc taco · cfbc5a8a
  lintangsutawika authored Aug 15, 2023
  
  cfbc5a8a
- format · 135b41ce
  lintangsutawika authored Aug 15, 2023
  
  135b41ce
- edit readme · 0436b5d6
  lintangsutawika authored Aug 15, 2023
  
  0436b5d6
- add all truthfulqa tasks · b990b756
  lintangsutawika authored Aug 15, 2023
  
  b990b756
- Merge pull request #779 from EleutherAI/pawsx · 8eab2a58
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Paws-X
```
  8eab2a58
- edit xstorycloze · 523ba954
  lintangsutawika authored Aug 15, 2023
  
  523ba954
- update triviaqa · 5be5cfcf
  lintangsutawika authored Aug 15, 2023
  
  5be5cfcf
- udpate storycloze · 14ad1317
  lintangsutawika authored Aug 15, 2023
  
  14ad1317
- update glue · 95b2a7d2
  lintangsutawika authored Aug 15, 2023
  
  95b2a7d2
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into add-readme · 95360bc2
  lintangsutawika authored Aug 15, 2023
  
  95360bc2
- Merge pull request #758 from EleutherAI/add_triviaqa · 30aa9c33
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Add triviaqa
```
  30aa9c33
- Update README.md · 4b0ab122
  Lintang Sutawika authored Aug 15, 2023
  
  4b0ab122
- Merge pull request #761 from EleutherAI/glue · 0629a8bf
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Glue
```
  0629a8bf
- merge big-refactor · b78a0045
  lintangsutawika authored Aug 15, 2023
  
  b78a0045