Commits · 21aa92d26ffaf028976e25a7593abaee8f414d2e · gaoqiong / lm-evaluation-harness

15 Aug, 2023 2 commits
- rename var · 21aa92d2
  haileyschoelkopf authored Aug 15, 2023
  
  21aa92d2
- add translation tasks · 40f81c42
  haileyschoelkopf authored Aug 15, 2023
  
  40f81c42
14 Aug, 2023 6 commits
- Update with task list. · 1768f118
  Lintang Sutawika authored Aug 14, 2023
  
  1768f118
- adjustments to have `task` to modify a task name in benchmark · 3de2c0e7
  lintangsutawika authored Aug 14, 2023
  
  3de2c0e7
- return fewshot_delimiter if we get "" · 7758d16a
  lintangsutawika authored Aug 14, 2023
  
  7758d16a
- add warning log if prompt returns empty string · 1701c4e2
  lintangsutawika authored Aug 14, 2023
  
  1701c4e2
- add warning log if prompt returns empty string · 722b8974
  lintangsutawika authored Aug 14, 2023
  
  722b8974
- add warning log if prompt returns empty string · bc951ac1
  lintangsutawika authored Aug 14, 2023
  
  bc951ac1
13 Aug, 2023 9 commits
- formate · ce8c2b14
  lintangsutawika authored Aug 13, 2023
  
  ce8c2b14
- update and fixes · 5ddabc29
  lintangsutawika authored Aug 13, 2023
  
  5ddabc29
- reformat · c523063d
  lintangsutawika authored Aug 13, 2023
  
  c523063d
- xnli reformat · 2d54f2c9
  lintangsutawika authored Aug 13, 2023
  
  2d54f2c9
- xnli reformat · ac98d9e1
  lintangsutawika authored Aug 13, 2023
  
  ac98d9e1
- uncommented tasks · 22ece14a
  lintangsutawika authored Aug 13, 2023
  
  22ece14a
- moved to a new dir · f4813cfc
  lintangsutawika authored Aug 13, 2023
  
  f4813cfc
- update · 83683ddd
  lintangsutawika authored Aug 13, 2023
  
  83683ddd
- added xnli · 18e2d093
  lintangsutawika authored Aug 13, 2023
  
  18e2d093
12 Aug, 2023 2 commits
- fix multi-metric greedy_until · df6c5dcb
  haileyschoelkopf authored Aug 12, 2023
  
  df6c5dcb
- make chrf and ter aggregations · 116c540a
  haileyschoelkopf authored Aug 12, 2023
  
  116c540a
11 Aug, 2023 3 commits
- switch to process_docs · 8189eb18
  haileyschoelkopf authored Aug 11, 2023
  
  8189eb18
- support bleu score as a metric · 8806eff5
  haileyschoelkopf authored Aug 11, 2023
  
  8806eff5
- placate pre-commit · d69a962d
  Hailey Schoelkopf authored Aug 10, 2023
  
  d69a962d
10 Aug, 2023 8 commits
- Use evaluation_mode=True for accelerate to prevent OOM · c7ef3da7
  Til Jasper Ullrich authored Aug 10, 2023
  
  c7ef3da7
- Patch Blimp · 506a32ac
  Lintang Sutawika authored Aug 10, 2023
  
  506a32ac
- Update utils.py · bede79c2
  Hailey Schoelkopf authored Aug 10, 2023
  
  bede79c2
- Update crows_pairs_english.yaml · 83ed584c
  Hailey Schoelkopf authored Aug 10, 2023
  
  83ed584c
- fix higher_is_better · 367f9693
  haileyschoelkopf authored Aug 10, 2023
  
  367f9693
- Update README.md · f0cc1507
  Lintang Sutawika authored Aug 10, 2023
  
  f0cc1507
- format · b22ccf92
  lintangsutawika authored Aug 10, 2023
  
  b22ccf92
- add blimp · b20bb95f
  lintangsutawika authored Aug 10, 2023
  
  b20bb95f
09 Aug, 2023 3 commits
- checklist README.md · 53487cf6
  lintangsutawika authored Aug 09, 2023
  
  53487cf6
- doc_to_target set to just label · ce1389c9
  lintangsutawika authored Aug 09, 2023
  
  ce1389c9
- pre-commit format · dd8bbe2c
  lintangsutawika authored Aug 09, 2023
  
  dd8bbe2c
08 Aug, 2023 7 commits
- fix error in a logging msg · f33d3758
  haileyschoelkopf authored Aug 08, 2023
  
  f33d3758
- add babi task · 87323176
  haileyschoelkopf authored Aug 08, 2023
  
  87323176
- add documentation on tasks · 3c8610c5
  haileyschoelkopf authored Aug 08, 2023
  
  3c8610c5
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106