Commits · 33273d6ef7d5fbdd7299f9e2eb5eb8d11fdfd2ff · gaoqiong / lm-evaluation-harness

"test/vscode:/vscode.git/clone" did not exist on "92777135a0afd0fb78feadbd7f703fb9c9a64cee"

14 Aug, 2023 8 commits
- pull and modified input args to metric · 33273d6e
  lintangsutawika authored Aug 03, 2023
  
  33273d6e
- Removed Implementation from metrics.py · 60763408
  Aflah authored Aug 03, 2023
  
  60763408
- Addressed Review Comments · ce7eb7b6
  Aflah authored Aug 03, 2023
  
  ce7eb7b6
- Fixed Wrong File Push · 67bbc5b4
  Aflah authored Aug 03, 2023
  
  67bbc5b4
- Improved DocString · 57bcb4d6
  Aflah authored Aug 02, 2023
  
  57bcb4d6
- CMD Line Works · b221531a
  Aflah authored Aug 02, 2023
  
  b221531a
- Added Metric and Seems to Run but some Errors · d857e539
  Aflah authored Aug 02, 2023
  
  d857e539
- Base Template · 94ccc429
  Aflah authored Aug 02, 2023
  
  94ccc429
11 Aug, 2023 1 commit
- placate pre-commit · d69a962d
  Hailey Schoelkopf authored Aug 10, 2023
  
  d69a962d
10 Aug, 2023 5 commits
- Use evaluation_mode=True for accelerate to prevent OOM · c7ef3da7
  Til Jasper Ullrich authored Aug 10, 2023
  
  c7ef3da7
- Patch Blimp · 506a32ac
  Lintang Sutawika authored Aug 10, 2023
  
  506a32ac
- Update README.md · f0cc1507
  Lintang Sutawika authored Aug 10, 2023
  
  f0cc1507
- format · b22ccf92
  lintangsutawika authored Aug 10, 2023
  
  b22ccf92
- add blimp · b20bb95f
  lintangsutawika authored Aug 10, 2023
  
  b20bb95f
09 Aug, 2023 3 commits
- checklist README.md · 53487cf6
  lintangsutawika authored Aug 09, 2023
  
  53487cf6
- doc_to_target set to just label · ce1389c9
  lintangsutawika authored Aug 09, 2023
  
  ce1389c9
- pre-commit format · dd8bbe2c
  lintangsutawika authored Aug 09, 2023
  
  dd8bbe2c
08 Aug, 2023 14 commits
- fix error in a logging msg · f33d3758
  haileyschoelkopf authored Aug 08, 2023
  
  f33d3758
- add babi task · 87323176
  haileyschoelkopf authored Aug 08, 2023
  
  87323176
- add documentation on tasks · 3c8610c5
  haileyschoelkopf authored Aug 08, 2023
  
  3c8610c5
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106
- ensure multiple_choice task type respects target_delimiter · cf1370d1
  haileyschoelkopf authored Aug 08, 2023
  
  cf1370d1
- add xcopa · 1a2cf3b2
  lintangsutawika authored Aug 08, 2023
  
  1a2cf3b2
- Update README.md · 7f69c48b
  Lintang Sutawika authored Aug 08, 2023
  
  7f69c48b
- Update README.md · e4ceb227
  Hailey Schoelkopf authored Aug 08, 2023
  
  e4ceb227
- Update README.md · 07bd8c03
  Hailey Schoelkopf authored Aug 08, 2023
  
  07bd8c03
- Update README.md · a9de5550
  Hailey Schoelkopf authored Aug 08, 2023
  
  a9de5550
- added typehints · 97f5c020
  baberabb authored Aug 08, 2023
  
  97f5c020
07 Aug, 2023 4 commits
- added tiktoken and changed openai dependency to optional · a5d57f15
  baberabb authored Aug 07, 2023
  
  a5d57f15
- added logliklihood_rolling and fixed greedy_until · 8ad386eb
  baberabb authored Aug 07, 2023
  
  8ad386eb
- added typehints and updated docs · 331340ad
  baberabb authored Aug 07, 2023
  
  331340ad
- Update error message if task name misspelt · 7aff9b75
  baberabb authored Aug 07, 2023
  
  7aff9b75
06 Aug, 2023 1 commit
- added methods to openai · 718eaec8
  baberabb authored Aug 06, 2023
  
  718eaec8
05 Aug, 2023 1 commit
- added type hints · eabadf46
  baberabb authored Aug 05, 2023
  
  eabadf46
04 Aug, 2023 3 commits
- make AnthropicLM class still registered when missing anthropic extra · e49972b0
  haileyschoelkopf authored Aug 04, 2023
  
  e49972b0
- remove num_fewshot in table that was supposed to be removed in benchmark-scripts · 07f94446
  lintangsutawika authored Aug 04, 2023
  
  07f94446
- Update evaluator.py · fa2d592a
  Lintang Sutawika authored Aug 04, 2023
  
  fa2d592a