Commits · 9f4682a33c330a8d1e53e6efdfd55bc4bfd0c39e · gaoqiong / lm-evaluation-harness

16 Aug, 2023 12 commits
- fixed typos · 9f4682a3
  lintangsutawika authored Aug 16, 2023
  
  9f4682a3
- reformat · 5a973941
  lintangsutawika authored Aug 16, 2023
  
  5a973941
- raise SystemExit 0 · 13f84b83
  lintangsutawika authored Aug 16, 2023
  
  13f84b83
- changed raise variable · 2fcd4298
  lintangsutawika authored Aug 16, 2023
  
  2fcd4298
- Update utils.py · 5b4f175f
  Lintang Sutawika authored Aug 16, 2023
  
  5b4f175f
- reformat · 579c9db9
  lintangsutawika authored Aug 16, 2023
  
  579c9db9
- change process to not require googleapi library · 60007dcf
  lintangsutawika authored Aug 16, 2023
  
  60007dcf
- reformat · d6030e12
  lintangsutawika authored Aug 16, 2023
  
  d6030e12
- fix doc_to_target processing · db37024b
  lintangsutawika authored Aug 16, 2023
  
  db37024b
- add task variants · 83f95961
  lintangsutawika authored Aug 16, 2023
  
  83f95961
- fix doc_to_choice being called when target is digit · d99e6cf4
  lintangsutawika authored Aug 16, 2023
  
  d99e6cf4
- add mgsm yamls · 3e9c9a95
  lintangsutawika authored Aug 16, 2023
  
  3e9c9a95
15 Aug, 2023 10 commits
- add mgsm · 416a3ca1
  lintangsutawika authored Aug 15, 2023
  
  416a3ca1
- update readme docs · da8af971
  lintangsutawika authored Aug 15, 2023
  
  da8af971
- add mc taco · cfbc5a8a
  lintangsutawika authored Aug 15, 2023
  
  cfbc5a8a
- format · 135b41ce
  lintangsutawika authored Aug 15, 2023
  
  135b41ce
- edit readme · 0436b5d6
  lintangsutawika authored Aug 15, 2023
  
  0436b5d6
- add all truthfulqa tasks · b990b756
  lintangsutawika authored Aug 15, 2023
  
  b990b756
- Update README.md · 4b0ab122
  Lintang Sutawika authored Aug 15, 2023
  
  4b0ab122
- Update README.md · 55749b9b
  Lintang Sutawika authored Aug 15, 2023
  
  55749b9b
- update · 6c587ba9
  lintangsutawika authored Aug 15, 2023
  
  6c587ba9
- add paws-x · e9377f72
  lintangsutawika authored Aug 15, 2023
  
  e9377f72
14 Aug, 2023 17 commits
- adjustments · 4c22a521
  lintangsutawika authored Aug 14, 2023
  
  4c22a521
- reformat · 88511112
  lintangsutawika authored Aug 03, 2023
  
  88511112
- pull and modified input args to metric · 33273d6e
  lintangsutawika authored Aug 03, 2023
  
  33273d6e
- Removed Implementation from metrics.py · 60763408
  Aflah authored Aug 03, 2023
  
  60763408
- Addressed Review Comments · ce7eb7b6
  Aflah authored Aug 03, 2023
  
  ce7eb7b6
- Fixed Wrong File Push · 67bbc5b4
  Aflah authored Aug 03, 2023
  
  67bbc5b4
- Improved DocString · 57bcb4d6
  Aflah authored Aug 02, 2023
  
  57bcb4d6
- CMD Line Works · b221531a
  Aflah authored Aug 02, 2023
  
  b221531a
- Added Metric and Seems to Run but some Errors · d857e539
  Aflah authored Aug 02, 2023
  
  d857e539
- Base Template · 94ccc429
  Aflah authored Aug 02, 2023
  
  94ccc429
- Update default.yaml · 416b198e
  Lintang Sutawika authored Aug 14, 2023
  
  416b198e
- Update with task list. · 1768f118
  Lintang Sutawika authored Aug 14, 2023
  
  1768f118
- adjustments to have `task` to modify a task name in benchmark · 3de2c0e7
  lintangsutawika authored Aug 14, 2023
  
  3de2c0e7
- return fewshot_delimiter if we get "" · 7758d16a
  lintangsutawika authored Aug 14, 2023
  
  7758d16a
- add warning log if prompt returns empty string · 1701c4e2
  lintangsutawika authored Aug 14, 2023
  
  1701c4e2
- add warning log if prompt returns empty string · 722b8974
  lintangsutawika authored Aug 14, 2023
  
  722b8974
- add warning log if prompt returns empty string · bc951ac1
  lintangsutawika authored Aug 14, 2023
  
  bc951ac1
13 Aug, 2023 1 commit
- formate · ce8c2b14
  lintangsutawika authored Aug 13, 2023
  
  ce8c2b14