Commits · 15821d2029c547fcbd048b36331a7357bc985f0d · gaoqiong / lm-evaluation-harness

09 Aug, 2023 4 commits
- Merge pull request #745 from EleutherAI/haileyschoelkopf-patch-1 · 15821d20
  Lintang Sutawika authored Aug 09, 2023
```
Update README.md
```
  15821d20
- Merge branch 'big-refactor' into haileyschoelkopf-patch-1 · 7483a7ea
  Lintang Sutawika authored Aug 09, 2023
  
  7483a7ea
- Merge pull request #751 from EleutherAI/crows-pair · 2f53b190
  Hailey Schoelkopf authored Aug 09, 2023
```
[Refactor] CrowS-Pairs
```
  2f53b190
- Merge pull request #752 from EleutherAI/babi-refactor · 5d55b685
  Lintang Sutawika authored Aug 09, 2023
```
[Refactor] Port Babi task
```
  5d55b685
08 Aug, 2023 14 commits
- fix error in a logging msg · f33d3758
  haileyschoelkopf authored Aug 08, 2023
  
  f33d3758
- add babi task · 87323176
  haileyschoelkopf authored Aug 08, 2023
  
  87323176
- add documentation on tasks · 3c8610c5
  haileyschoelkopf authored Aug 08, 2023
  
  3c8610c5
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106
- ensure multiple_choice task type respects target_delimiter · cf1370d1
  haileyschoelkopf authored Aug 08, 2023
  
  cf1370d1
- Update README.md · 7f69c48b
  Lintang Sutawika authored Aug 08, 2023
  
  7f69c48b
- Update README.md · e4ceb227
  Hailey Schoelkopf authored Aug 08, 2023
  
  e4ceb227
- Update README.md · 07bd8c03
  Hailey Schoelkopf authored Aug 08, 2023
  
  07bd8c03
- Update README.md · a9de5550
  Hailey Schoelkopf authored Aug 08, 2023
  
  a9de5550
- Merge pull request #742 from baberabb/big-refactor_typehints · 1710b42d
  Hailey Schoelkopf authored Aug 08, 2023
```
[Refactor] added some typehints
```
  1710b42d
- added typehints · 97f5c020
  baberabb authored Aug 08, 2023
  
  97f5c020
07 Aug, 2023 8 commits
- Merge pull request #736 from baberabb/big-refactor_opai · b0f67f2c
  Hailey Schoelkopf authored Aug 07, 2023
```
[Refactor] fixed openai
```
  b0f67f2c
- added typehints to readme · ca386392
  baberabb authored Aug 07, 2023
  
  ca386392
- added tiktoken and changed openai dependency to optional · a5d57f15
  baberabb authored Aug 07, 2023
  
  a5d57f15
- added logliklihood_rolling and fixed greedy_until · 8ad386eb
  baberabb authored Aug 07, 2023
  
  8ad386eb
- Merge pull request #739 from yeoedward/fix_packaging · 6c753760
  Lintang Sutawika authored Aug 07, 2023
```
Fix task packaging
```
  6c753760
- Fix task packaging · f70cbed9
  Eddy Yeo authored Aug 07, 2023
  
  f70cbed9
- added typehints and updated docs · 331340ad
  baberabb authored Aug 07, 2023
  
  331340ad
- Update error message if task name misspelt · 7aff9b75
  baberabb authored Aug 07, 2023
  
  7aff9b75
06 Aug, 2023 1 commit
- added methods to openai · 718eaec8
  baberabb authored Aug 06, 2023
  
  718eaec8
05 Aug, 2023 1 commit
- added type hints · eabadf46
  baberabb authored Aug 05, 2023
  
  eabadf46
04 Aug, 2023 12 commits
- Merge pull request #711 from baberabb/big-refactor-logiqav2 · e9b938f2
  Hailey Schoelkopf authored Aug 04, 2023
```
[Refactor] logiqav2
```
  e9b938f2
- Merge pull request #734 from EleutherAI/fix-table · 321aef35
  Hailey Schoelkopf authored Aug 04, 2023
```
[Refactor] Remove Unused Variable in Make-Table
```
  321aef35
- Merge branch 'big-refactor' into fix-table · c098188d
  haileyschoelkopf authored Aug 04, 2023
  
  c098188d
- Merge branch 'big-refactor' into fix-table · f55250ab
  haileyschoelkopf authored Aug 04, 2023
  
  f55250ab
- Merge pull request #724 from EleutherAI/Refactor]-fix-anthropic-import-bug · 0a0f879c
  Lintang Sutawika authored Aug 04, 2023
```
[Refactor] Fix Anthropic Import
```
  0a0f879c
- make AnthropicLM class still registered when missing anthropic extra · e49972b0
  haileyschoelkopf authored Aug 04, 2023
  
  e49972b0
- remove num_fewshot in table that was supposed to be removed in benchmark-scripts · 07f94446
  lintangsutawika authored Aug 04, 2023
  
  07f94446
- Update evaluator.py · fa2d592a
  Lintang Sutawika authored Aug 04, 2023
  
  fa2d592a
- Merge branch 'Refactor]-fix-anthropic-import-bug' of... · d0add6e5
  lintangsutawika authored Aug 04, 2023
```
Merge branch 'Refactor]-fix-anthropic-import-bug' of https://github.com/EleutherAI/lm-evaluation-harness into Refactor]-fix-anthropic-import-bug
```
  d0add6e5
- pre-commit format · 2f4124fa
  lintangsutawika authored Aug 04, 2023
  
  2f4124fa
- Merge branch 'big-refactor' of... · 804c6ffe
  lintangsutawika authored Aug 04, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into Refactor]-fix-anthropic-import-bug
```
  804c6ffe
- Update setup.py · aa1cf230
  Lintang Sutawika authored Aug 04, 2023
  
  aa1cf230