Commits · 4b0ab122a699141f402190aab65dd170d552bdb0 · gaoqiong / lm-evaluation-harness

15 Aug, 2023 1 commit
- Update README.md · 4b0ab122
  Lintang Sutawika authored Aug 15, 2023
  
  4b0ab122
14 Aug, 2023 1 commit
- Update default.yaml · 416b198e
  Lintang Sutawika authored Aug 14, 2023
  
  416b198e
09 Aug, 2023 16 commits
- add sampler condition for if target is multiple, and target_delimiter is " " · 1d3599a3
  lintangsutawika authored Aug 09, 2023
  
  1d3599a3
- reformat · 87e147e1
  lintangsutawika authored Aug 09, 2023
  
  87e147e1
- add trivieqa · 6accb48f
  lintangsutawika authored Aug 09, 2023
  
  6accb48f
- removed line · 898cdd8b
  lintangsutawika authored Aug 09, 2023
  
  898cdd8b
- added new filter to remove whitespace in the front of a prediction · 489edf2c
  lintangsutawika authored Aug 09, 2023
  
  489edf2c
- allow doc_to_target to be list so that multiple_target works · c2990e29
  lintangsutawika authored Aug 09, 2023
  
  c2990e29
- added triviaqa · c86fd1a7
  lintangsutawika authored Aug 09, 2023
  
  c86fd1a7
- Merge pull request #749 from EleutherAI/xcopa · d1a44c85
  Lintang Sutawika authored Aug 09, 2023
```
[Refactor] add xcopa
```
  d1a44c85
- Merge branch 'big-refactor' into xcopa · 47ceb0a0
  Lintang Sutawika authored Aug 09, 2023
  
  47ceb0a0
- Merge pull request #745 from EleutherAI/haileyschoelkopf-patch-1 · 15821d20
  Lintang Sutawika authored Aug 09, 2023
```
Update README.md
```
  15821d20
- Merge branch 'big-refactor' into haileyschoelkopf-patch-1 · 7483a7ea
  Lintang Sutawika authored Aug 09, 2023
  
  7483a7ea
- Merge pull request #751 from EleutherAI/crows-pair · 2f53b190
  Hailey Schoelkopf authored Aug 09, 2023
```
[Refactor] CrowS-Pairs
```
  2f53b190
- checklist README.md · 53487cf6
  lintangsutawika authored Aug 09, 2023
  
  53487cf6
- Merge pull request #752 from EleutherAI/babi-refactor · 5d55b685
  Lintang Sutawika authored Aug 09, 2023
```
[Refactor] Port Babi task
```
  5d55b685
- doc_to_target set to just label · ce1389c9
  lintangsutawika authored Aug 09, 2023
  
  ce1389c9
- pre-commit format · dd8bbe2c
  lintangsutawika authored Aug 09, 2023
  
  dd8bbe2c
08 Aug, 2023 15 commits
- fix error in a logging msg · f33d3758
  haileyschoelkopf authored Aug 08, 2023
  
  f33d3758
- add babi task · 87323176
  haileyschoelkopf authored Aug 08, 2023
  
  87323176
- add documentation on tasks · 3c8610c5
  haileyschoelkopf authored Aug 08, 2023
  
  3c8610c5
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106
- ensure multiple_choice task type respects target_delimiter · cf1370d1
  haileyschoelkopf authored Aug 08, 2023
  
  cf1370d1
- add xcopa · 1a2cf3b2
  lintangsutawika authored Aug 08, 2023
  
  1a2cf3b2
- Update README.md · 7f69c48b
  Lintang Sutawika authored Aug 08, 2023
  
  7f69c48b
- Update README.md · e4ceb227
  Hailey Schoelkopf authored Aug 08, 2023
  
  e4ceb227
- Update README.md · 07bd8c03
  Hailey Schoelkopf authored Aug 08, 2023
  
  07bd8c03
- Update README.md · a9de5550
  Hailey Schoelkopf authored Aug 08, 2023
  
  a9de5550
- Merge pull request #742 from baberabb/big-refactor_typehints · 1710b42d
  Hailey Schoelkopf authored Aug 08, 2023
```
[Refactor] added some typehints
```
  1710b42d
- added typehints · 97f5c020
  baberabb authored Aug 08, 2023
  
  97f5c020
07 Aug, 2023 7 commits
- Merge pull request #736 from baberabb/big-refactor_opai · b0f67f2c
  Hailey Schoelkopf authored Aug 07, 2023
```
[Refactor] fixed openai
```
  b0f67f2c
- added typehints to readme · ca386392
  baberabb authored Aug 07, 2023
  
  ca386392
- added tiktoken and changed openai dependency to optional · a5d57f15
  baberabb authored Aug 07, 2023
  
  a5d57f15
- added logliklihood_rolling and fixed greedy_until · 8ad386eb
  baberabb authored Aug 07, 2023
  
  8ad386eb
- Merge pull request #739 from yeoedward/fix_packaging · 6c753760
  Lintang Sutawika authored Aug 07, 2023
```
Fix task packaging
```
  6c753760
- Fix task packaging · f70cbed9
  Eddy Yeo authored Aug 07, 2023
  
  f70cbed9
- added typehints and updated docs · 331340ad
  baberabb authored Aug 07, 2023
  
  331340ad