Commits · 129762c2496014e283554429e60431597df26f50 · gaoqiong / lm-evaluation-harness

"sgl-kernel/benchmark/bench_top_k_top_p_sampling.py" did not exist on "432f2053ddfe545abddb6252520dc21f7ee2b410"

17 Aug, 2023 1 commit
- update readme on translation tasks · 603eced6
  haileyschoelkopf authored Aug 17, 2023
  
  603eced6
15 Aug, 2023 6 commits
- rename var · 21aa92d2
  haileyschoelkopf authored Aug 15, 2023
  
  21aa92d2
- add translation tasks · 40f81c42
  haileyschoelkopf authored Aug 15, 2023
  
  40f81c42
- Update README.md · 4b0ab122
  Lintang Sutawika authored Aug 15, 2023
  
  4b0ab122
- Update README.md · 55749b9b
  Lintang Sutawika authored Aug 15, 2023
  
  55749b9b
- update · 6c587ba9
  lintangsutawika authored Aug 15, 2023
  
  6c587ba9
- add paws-x · e9377f72
  lintangsutawika authored Aug 15, 2023
  
  e9377f72
14 Aug, 2023 17 commits
- adjustments · 4c22a521
  lintangsutawika authored Aug 14, 2023
  
  4c22a521
- reformat · 88511112
  lintangsutawika authored Aug 03, 2023
  
  88511112
- pull and modified input args to metric · 33273d6e
  lintangsutawika authored Aug 03, 2023
  
  33273d6e
- Removed Implementation from metrics.py · 60763408
  Aflah authored Aug 03, 2023
  
  60763408
- Addressed Review Comments · ce7eb7b6
  Aflah authored Aug 03, 2023
  
  ce7eb7b6
- Fixed Wrong File Push · 67bbc5b4
  Aflah authored Aug 03, 2023
  
  67bbc5b4
- Improved DocString · 57bcb4d6
  Aflah authored Aug 02, 2023
  
  57bcb4d6
- CMD Line Works · b221531a
  Aflah authored Aug 02, 2023
  
  b221531a
- Added Metric and Seems to Run but some Errors · d857e539
  Aflah authored Aug 02, 2023
  
  d857e539
- Base Template · 94ccc429
  Aflah authored Aug 02, 2023
  
  94ccc429
- Update default.yaml · 416b198e
  Lintang Sutawika authored Aug 14, 2023
  
  416b198e
- Update with task list. · 1768f118
  Lintang Sutawika authored Aug 14, 2023
  
  1768f118
- adjustments to have `task` to modify a task name in benchmark · 3de2c0e7
  lintangsutawika authored Aug 14, 2023
  
  3de2c0e7
- return fewshot_delimiter if we get "" · 7758d16a
  lintangsutawika authored Aug 14, 2023
  
  7758d16a
- add warning log if prompt returns empty string · 1701c4e2
  lintangsutawika authored Aug 14, 2023
  
  1701c4e2
- add warning log if prompt returns empty string · 722b8974
  lintangsutawika authored Aug 14, 2023
  
  722b8974
- add warning log if prompt returns empty string · bc951ac1
  lintangsutawika authored Aug 14, 2023
  
  bc951ac1
13 Aug, 2023 10 commits
- formate · ce8c2b14
  lintangsutawika authored Aug 13, 2023
  
  ce8c2b14
- update and fixes · 5ddabc29
  lintangsutawika authored Aug 13, 2023
  
  5ddabc29
- reformat · c523063d
  lintangsutawika authored Aug 13, 2023
  
  c523063d
- check readme · 81a6cbfa
  lintangsutawika authored Aug 13, 2023
  
  81a6cbfa
- xnli reformat · 2d54f2c9
  lintangsutawika authored Aug 13, 2023
  
  2d54f2c9
- xnli reformat · ac98d9e1
  lintangsutawika authored Aug 13, 2023
  
  ac98d9e1
- uncommented tasks · 22ece14a
  lintangsutawika authored Aug 13, 2023
  
  22ece14a
- moved to a new dir · f4813cfc
  lintangsutawika authored Aug 13, 2023
  
  f4813cfc
- update · 83683ddd
  lintangsutawika authored Aug 13, 2023
  
  83683ddd
- added xnli · 18e2d093
  lintangsutawika authored Aug 13, 2023
  
  18e2d093
12 Aug, 2023 2 commits
- fix multi-metric greedy_until · df6c5dcb
  haileyschoelkopf authored Aug 12, 2023
  
  df6c5dcb
- make chrf and ter aggregations · 116c540a
  haileyschoelkopf authored Aug 12, 2023
  
  116c540a
11 Aug, 2023 3 commits
- switch to process_docs · 8189eb18
  haileyschoelkopf authored Aug 11, 2023
  
  8189eb18
- support bleu score as a metric · 8806eff5
  haileyschoelkopf authored Aug 11, 2023
  
  8806eff5
- placate pre-commit · d69a962d
  Hailey Schoelkopf authored Aug 10, 2023
  
  d69a962d
10 Aug, 2023 1 commit
- Use evaluation_mode=True for accelerate to prevent OOM · c7ef3da7
  Til Jasper Ullrich authored Aug 10, 2023
  
  c7ef3da7