Commits · 8dbb795827330ce27259aebb445d4ec0bbecaece · gaoqiong / lm-evaluation-harness

14 Aug, 2023 2 commits
- Update README.md · 8dbb7958
  Lintang Sutawika authored Aug 14, 2023
  
  8dbb7958
- Update README.md · be2ebb3b
  Lintang Sutawika authored Aug 14, 2023
  
  be2ebb3b
09 Aug, 2023 10 commits
- Update README.md · dbf03c05
  Lintang Sutawika authored Aug 09, 2023
  
  dbf03c05
- Update README.md · 375346e6
  Lintang Sutawika authored Aug 09, 2023
  
  375346e6
- Update README.md · 60007357
  Lintang Sutawika authored Aug 09, 2023
  
  60007357
- Create README.md · 5e2d2958
  Lintang Sutawika authored Aug 09, 2023
  
  5e2d2958
- Create README.md · 8ef93f15
  Lintang Sutawika authored Aug 09, 2023
  
  8ef93f15
- Update README.md · 3a67a226
  Lintang Sutawika authored Aug 09, 2023
  
  3a67a226
- Update README.md · d8f96404
  Lintang Sutawika authored Aug 09, 2023
  
  d8f96404
- checklist README.md · 53487cf6
  lintangsutawika authored Aug 09, 2023
  
  53487cf6
- doc_to_target set to just label · ce1389c9
  lintangsutawika authored Aug 09, 2023
  
  ce1389c9
- pre-commit format · dd8bbe2c
  lintangsutawika authored Aug 09, 2023
  
  dd8bbe2c
08 Aug, 2023 14 commits
- fix error in a logging msg · f33d3758
  haileyschoelkopf authored Aug 08, 2023
  
  f33d3758
- add babi task · 87323176
  haileyschoelkopf authored Aug 08, 2023
  
  87323176
- add documentation on tasks · 3c8610c5
  haileyschoelkopf authored Aug 08, 2023
  
  3c8610c5
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106
- ensure multiple_choice task type respects target_delimiter · cf1370d1
  haileyschoelkopf authored Aug 08, 2023
  
  cf1370d1
- add xcopa · 1a2cf3b2
  lintangsutawika authored Aug 08, 2023
  
  1a2cf3b2
- Update README.md · 7f69c48b
  Lintang Sutawika authored Aug 08, 2023
  
  7f69c48b
- Update README.md · e4ceb227
  Hailey Schoelkopf authored Aug 08, 2023
  
  e4ceb227
- Update README.md · 07bd8c03
  Hailey Schoelkopf authored Aug 08, 2023
  
  07bd8c03
- Update README.md · a9de5550
  Hailey Schoelkopf authored Aug 08, 2023
  
  a9de5550
- added typehints · 97f5c020
  baberabb authored Aug 08, 2023
  
  97f5c020
07 Aug, 2023 4 commits
- added tiktoken and changed openai dependency to optional · a5d57f15
  baberabb authored Aug 07, 2023
  
  a5d57f15
- added logliklihood_rolling and fixed greedy_until · 8ad386eb
  baberabb authored Aug 07, 2023
  
  8ad386eb
- added typehints and updated docs · 331340ad
  baberabb authored Aug 07, 2023
  
  331340ad
- Update error message if task name misspelt · 7aff9b75
  baberabb authored Aug 07, 2023
  
  7aff9b75
06 Aug, 2023 1 commit
- added methods to openai · 718eaec8
  baberabb authored Aug 06, 2023
  
  718eaec8
05 Aug, 2023 1 commit
- added type hints · eabadf46
  baberabb authored Aug 05, 2023
  
  eabadf46
04 Aug, 2023 6 commits
- make AnthropicLM class still registered when missing anthropic extra · e49972b0
  haileyschoelkopf authored Aug 04, 2023
  
  e49972b0
- remove num_fewshot in table that was supposed to be removed in benchmark-scripts · 07f94446
  lintangsutawika authored Aug 04, 2023
  
  07f94446
- Update evaluator.py · fa2d592a
  Lintang Sutawika authored Aug 04, 2023
  
  fa2d592a
- pre-commit format · 2f4124fa
  lintangsutawika authored Aug 04, 2023
  
  2f4124fa
- reformat · b3a8c985
  lintangsutawika authored Aug 04, 2023
  
  b3a8c985
- Update __init__.py · 881fcf15
  Lintang Sutawika authored Aug 04, 2023
  
  881fcf15
03 Aug, 2023 1 commit
- Update huggingface.py · f40c434e
  Lintang Sutawika authored Aug 03, 2023
```
`max_length` was misdefined as a tuple.
```
  f40c434e
02 Aug, 2023 1 commit
- Update task.py · 53105bba
  Lintang Sutawika authored Aug 02, 2023
  
  53105bba