Commits · a5a9017ba29909bf409449f8482f558da62085a5 · gaoqiong / lm-evaluation-harness

"vscode:/vscode.git/clone" did not exist on "c75ce009a9ccfd0975400da7de0a69b304f09431"

10 Aug, 2023 6 commits
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into xstorycloze · a5a9017b
  lintangsutawika authored Aug 10, 2023
  
  a5a9017b
- Merge pull request #763 from EleutherAI/blimp · 7634a6ec
  Lintang Sutawika authored Aug 10, 2023
```
[Refactor] Add Blimp
```
  7634a6ec
- Merge pull request #764 from EleutherAI/lintangsutawika-patch-2 · 4907defd
  Hailey Schoelkopf authored Aug 10, 2023
```
Update README.md
```
  4907defd
- Update README.md · f0cc1507
  Lintang Sutawika authored Aug 10, 2023
  
  f0cc1507
- format · b22ccf92
  lintangsutawika authored Aug 10, 2023
  
  b22ccf92
- add blimp · b20bb95f
  lintangsutawika authored Aug 10, 2023
  
  b20bb95f
09 Aug, 2023 13 commits
- forgot " · a04a600a
  lintangsutawika authored Aug 09, 2023
  
  a04a600a
- forgot to add doc_to_choice · af3fbe03
  lintangsutawika authored Aug 09, 2023
  
  af3fbe03
- fix import · cf96455a
  lintangsutawika authored Aug 09, 2023
  
  cf96455a
- added xstory cloze · 43bb4145
  lintangsutawika authored Aug 09, 2023
  
  43bb4145
- Merge pull request #749 from EleutherAI/xcopa · d1a44c85
  Lintang Sutawika authored Aug 09, 2023
```
[Refactor] add xcopa
```
  d1a44c85
- Merge branch 'big-refactor' into xcopa · 47ceb0a0
  Lintang Sutawika authored Aug 09, 2023
  
  47ceb0a0
- Merge pull request #745 from EleutherAI/haileyschoelkopf-patch-1 · 15821d20
  Lintang Sutawika authored Aug 09, 2023
```
Update README.md
```
  15821d20
- Merge branch 'big-refactor' into haileyschoelkopf-patch-1 · 7483a7ea
  Lintang Sutawika authored Aug 09, 2023
  
  7483a7ea
- Merge pull request #751 from EleutherAI/crows-pair · 2f53b190
  Hailey Schoelkopf authored Aug 09, 2023
```
[Refactor] CrowS-Pairs
```
  2f53b190
- checklist README.md · 53487cf6
  lintangsutawika authored Aug 09, 2023
  
  53487cf6
- Merge pull request #752 from EleutherAI/babi-refactor · 5d55b685
  Lintang Sutawika authored Aug 09, 2023
```
[Refactor] Port Babi task
```
  5d55b685
- doc_to_target set to just label · ce1389c9
  lintangsutawika authored Aug 09, 2023
  
  ce1389c9
- pre-commit format · dd8bbe2c
  lintangsutawika authored Aug 09, 2023
  
  dd8bbe2c
08 Aug, 2023 15 commits
- fix error in a logging msg · f33d3758
  haileyschoelkopf authored Aug 08, 2023
  
  f33d3758
- add babi task · 87323176
  haileyschoelkopf authored Aug 08, 2023
  
  87323176
- add documentation on tasks · 3c8610c5
  haileyschoelkopf authored Aug 08, 2023
  
  3c8610c5
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106
- ensure multiple_choice task type respects target_delimiter · cf1370d1
  haileyschoelkopf authored Aug 08, 2023
  
  cf1370d1
- add xcopa · 1a2cf3b2
  lintangsutawika authored Aug 08, 2023
  
  1a2cf3b2
- Update README.md · 7f69c48b
  Lintang Sutawika authored Aug 08, 2023
  
  7f69c48b
- Update README.md · e4ceb227
  Hailey Schoelkopf authored Aug 08, 2023
  
  e4ceb227
- Update README.md · 07bd8c03
  Hailey Schoelkopf authored Aug 08, 2023
  
  07bd8c03
- Update README.md · a9de5550
  Hailey Schoelkopf authored Aug 08, 2023
  
  a9de5550
- Merge pull request #742 from baberabb/big-refactor_typehints · 1710b42d
  Hailey Schoelkopf authored Aug 08, 2023
```
[Refactor] added some typehints
```
  1710b42d
- added typehints · 97f5c020
  baberabb authored Aug 08, 2023
  
  97f5c020
07 Aug, 2023 6 commits
- Merge pull request #736 from baberabb/big-refactor_opai · b0f67f2c
  Hailey Schoelkopf authored Aug 07, 2023
```
[Refactor] fixed openai
```
  b0f67f2c
- added typehints to readme · ca386392
  baberabb authored Aug 07, 2023
  
  ca386392
- added tiktoken and changed openai dependency to optional · a5d57f15
  baberabb authored Aug 07, 2023
  
  a5d57f15
- added logliklihood_rolling and fixed greedy_until · 8ad386eb
  baberabb authored Aug 07, 2023
  
  8ad386eb
- Merge pull request #739 from yeoedward/fix_packaging · 6c753760
  Lintang Sutawika authored Aug 07, 2023
```
Fix task packaging
```
  6c753760
- Fix task packaging · f70cbed9
  Eddy Yeo authored Aug 07, 2023
  
  f70cbed9