Commits · 57bcb4d66a9b6a5a920ca8c37b400a7e5008aced · gaoqiong / lm-evaluation-harness

"megatron/vscode:/vscode.git/clone" did not exist on "56e16cbaf69f92da94a3a4bc9d5f9629f4634a5f"

14 Aug, 2023 4 commits
- Improved DocString · 57bcb4d6
  Aflah authored Aug 02, 2023
  
  57bcb4d6
- CMD Line Works · b221531a
  Aflah authored Aug 02, 2023
  
  b221531a
- Added Metric and Seems to Run but some Errors · d857e539
  Aflah authored Aug 02, 2023
  
  d857e539
- Base Template · 94ccc429
  Aflah authored Aug 02, 2023
  
  94ccc429
11 Aug, 2023 1 commit
- placate pre-commit · d69a962d
  Hailey Schoelkopf authored Aug 10, 2023
  
  d69a962d
10 Aug, 2023 5 commits
- Use evaluation_mode=True for accelerate to prevent OOM · c7ef3da7
  Til Jasper Ullrich authored Aug 10, 2023
  
  c7ef3da7
- Patch Blimp · 506a32ac
  Lintang Sutawika authored Aug 10, 2023
  
  506a32ac
- Update README.md · f0cc1507
  Lintang Sutawika authored Aug 10, 2023
  
  f0cc1507
- format · b22ccf92
  lintangsutawika authored Aug 10, 2023
  
  b22ccf92
- add blimp · b20bb95f
  lintangsutawika authored Aug 10, 2023
  
  b20bb95f
09 Aug, 2023 3 commits
- checklist README.md · 53487cf6
  lintangsutawika authored Aug 09, 2023
  
  53487cf6
- doc_to_target set to just label · ce1389c9
  lintangsutawika authored Aug 09, 2023
  
  ce1389c9
- pre-commit format · dd8bbe2c
  lintangsutawika authored Aug 09, 2023
  
  dd8bbe2c
08 Aug, 2023 14 commits
- fix error in a logging msg · f33d3758
  haileyschoelkopf authored Aug 08, 2023
  
  f33d3758
- add babi task · 87323176
  haileyschoelkopf authored Aug 08, 2023
  
  87323176
- add documentation on tasks · 3c8610c5
  haileyschoelkopf authored Aug 08, 2023
  
  3c8610c5
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106
- ensure multiple_choice task type respects target_delimiter · cf1370d1
  haileyschoelkopf authored Aug 08, 2023
  
  cf1370d1
- add xcopa · 1a2cf3b2
  lintangsutawika authored Aug 08, 2023
  
  1a2cf3b2
- Update README.md · 7f69c48b
  Lintang Sutawika authored Aug 08, 2023
  
  7f69c48b
- Update README.md · e4ceb227
  Hailey Schoelkopf authored Aug 08, 2023
  
  e4ceb227
- Update README.md · 07bd8c03
  Hailey Schoelkopf authored Aug 08, 2023
  
  07bd8c03
- Update README.md · a9de5550
  Hailey Schoelkopf authored Aug 08, 2023
  
  a9de5550
- added typehints · 97f5c020
  baberabb authored Aug 08, 2023
  
  97f5c020
07 Aug, 2023 4 commits
- added tiktoken and changed openai dependency to optional · a5d57f15
  baberabb authored Aug 07, 2023
  
  a5d57f15
- added logliklihood_rolling and fixed greedy_until · 8ad386eb
  baberabb authored Aug 07, 2023
  
  8ad386eb
- added typehints and updated docs · 331340ad
  baberabb authored Aug 07, 2023
  
  331340ad
- Update error message if task name misspelt · 7aff9b75
  baberabb authored Aug 07, 2023
  
  7aff9b75
06 Aug, 2023 1 commit
- added methods to openai · 718eaec8
  baberabb authored Aug 06, 2023
  
  718eaec8
05 Aug, 2023 1 commit
- added type hints · eabadf46
  baberabb authored Aug 05, 2023
  
  eabadf46
04 Aug, 2023 6 commits
- make AnthropicLM class still registered when missing anthropic extra · e49972b0
  haileyschoelkopf authored Aug 04, 2023
  
  e49972b0
- remove num_fewshot in table that was supposed to be removed in benchmark-scripts · 07f94446
  lintangsutawika authored Aug 04, 2023
  
  07f94446
- Update evaluator.py · fa2d592a
  Lintang Sutawika authored Aug 04, 2023
  
  fa2d592a
- pre-commit format · 2f4124fa
  lintangsutawika authored Aug 04, 2023
  
  2f4124fa
- reformat · b3a8c985
  lintangsutawika authored Aug 04, 2023
  
  b3a8c985
- Update __init__.py · 881fcf15
  Lintang Sutawika authored Aug 04, 2023
  
  881fcf15
03 Aug, 2023 1 commit
- Update huggingface.py · f40c434e
  Lintang Sutawika authored Aug 03, 2023
```
`max_length` was misdefined as a tuple.
```
  f40c434e