Commits · 21706139103a8bf47bb06ae4f047749db7aecce2 · gaoqiong / lm-evaluation-harness

"test/vscode:/vscode.git/clone" did not exist on "0d197f2764c4908831f99c08ff98c0634da8f0f6"

20 Aug, 2023 2 commits
- increase atol · 21706139
  baberabb authored Aug 20, 2023
  
  21706139
- increase verbosity · a093ad5f
  baberabb authored Aug 20, 2023
  
  a093ad5f
19 Aug, 2023 6 commits
- Merge pull request #791 from baberabb/big-refactor_hgtest · 0cdd730e
  Hailey Schoelkopf authored Aug 19, 2023
```
[Refactor] Added HF model test
```
  0cdd730e
- atol=1e-8 · 51882c1e
  baberabb authored Aug 19, 2023
  
  51882c1e
- Merge branch 'big-refactor_hgtest' of... · 8d285244
  baberabb authored Aug 19, 2023
```
Merge branch 'big-refactor_hgtest' of https://github.com/baberabb/lm-evaluation-harness into big-refactor_hgtest

# Conflicts:
#	tests/models/test_huggingface.py
```
  8d285244
- add branch wildcard; pytest verbosity++ in case failure · 31ed1c2a
  baberabb authored Aug 19, 2023
  
  31ed1c2a
- get _RES from CI and change atol to 0.0001 · ac290ce8
  baberabb authored Aug 19, 2023
  
  ac290ce8
- add print to view result on CI · e1c46787
  baberabb authored Aug 19, 2023
  
  e1c46787
17 Aug, 2023 11 commits
- delete pull_request.yml · a004fdc0
  baberabb authored Aug 17, 2023
  
  a004fdc0
- consolidated precommit to linter · 9fc9fd02
  baberabb authored Aug 17, 2023
  
  9fc9fd02
- added indices equality check · da77b216
  baberabb authored Aug 17, 2023
  
  da77b216
- change logliklihood atol to 1e-2 · 72bb97ca
  baberabb authored Aug 17, 2023
  
  72bb97ca
- fixup! added tolerance for likelihood, rolling · 91a06081
  baberabb authored Aug 17, 2023
  
  91a06081
- added tolerance for likelihood, rolling · dbbc613f
  baberabb authored Aug 17, 2023
  
  dbbc613f
- added pip cache to CI · b9df9fb4
  baberabb authored Aug 17, 2023
  
  b9df9fb4
- Merge remote-tracking branch 'origin/big-refactor' into big-refactor_hgtest · c2e76e79
  baberabb authored Aug 17, 2023
  
  c2e76e79
- Merge pull request #788 from EleutherAI/fix-perspective-apikey · 1c5a73c9
  Lintang Sutawika authored Aug 17, 2023
```
[Refactor] Don't always require Perspective API key to run 
```
  1c5a73c9
- added hf model test · f0aa2c7b
  baberabb authored Aug 17, 2023
  
  f0aa2c7b
- don't exit if RTP api key not set · 197940f7
  haileyschoelkopf authored Aug 17, 2023
  
  197940f7
16 Aug, 2023 12 commits
- Merge pull request #757 from EleutherAI/add-readme · 759da8d5
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] Add README.md
```
  759da8d5
- Merge branch 'big-refactor' into add-readme · c05a5ad4
  Lintang Sutawika authored Aug 16, 2023
  
  c05a5ad4
- Merge pull request #786 from EleutherAI/fix-doc_to_target · 73912efb
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] fix doc_to_target processing
```
  73912efb
- raise SystemExit 0 · 13f84b83
  lintangsutawika authored Aug 16, 2023
  
  13f84b83
- changed raise variable · 2fcd4298
  lintangsutawika authored Aug 16, 2023
  
  2fcd4298
- Merge pull request #782 from EleutherAI/truthfulqa · e8825ef6
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] Truthfulqa
```
  e8825ef6
- Update utils.py · 5b4f175f
  Lintang Sutawika authored Aug 16, 2023
  
  5b4f175f
- Merge pull request #783 from EleutherAI/mctaco · d53a81b0
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] MC Taco
```
  d53a81b0
- reformat · 579c9db9
  lintangsutawika authored Aug 16, 2023
  
  579c9db9
- change process to not require googleapi library · 60007dcf
  lintangsutawika authored Aug 16, 2023
  
  60007dcf
- reformat · d6030e12
  lintangsutawika authored Aug 16, 2023
  
  d6030e12
- fix doc_to_target processing · db37024b
  lintangsutawika authored Aug 16, 2023
  
  db37024b
15 Aug, 2023 9 commits
- update readme docs · da8af971
  lintangsutawika authored Aug 15, 2023
  
  da8af971
- add mc taco · cfbc5a8a
  lintangsutawika authored Aug 15, 2023
  
  cfbc5a8a
- format · 135b41ce
  lintangsutawika authored Aug 15, 2023
  
  135b41ce
- edit readme · 0436b5d6
  lintangsutawika authored Aug 15, 2023
  
  0436b5d6
- add all truthfulqa tasks · b990b756
  lintangsutawika authored Aug 15, 2023
  
  b990b756
- Merge pull request #779 from EleutherAI/pawsx · 8eab2a58
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Paws-X
```
  8eab2a58
- edit xstorycloze · 523ba954
  lintangsutawika authored Aug 15, 2023
  
  523ba954
- update triviaqa · 5be5cfcf
  lintangsutawika authored Aug 15, 2023
  
  5be5cfcf
- udpate storycloze · 14ad1317
  lintangsutawika authored Aug 15, 2023
  
  14ad1317