Commits · f88ffeee12e8971763fbccbbb4d4792e1bb77da2 · gaoqiong / lm-evaluation-harness

21 Sep, 2023 1 commit
- Note [math] extra · c8f56b17
  Hailey Schoelkopf authored Sep 21, 2023
  
  c8f56b17
19 Sep, 2023 17 commits
- fixed task and benchmark adding process · f921fc19
  lintangsutawika authored Sep 19, 2023
  
  f921fc19
- Update mgsm_cot_native_zh.yaml · 4a967f26
  Lintang Sutawika authored Sep 19, 2023
  
  4a967f26
- Update mgsm_cot_native_th.yaml · 0f2ff6af
  Lintang Sutawika authored Sep 19, 2023
  
  0f2ff6af
- Update mgsm_cot_native_te.yaml · ae473f79
  Lintang Sutawika authored Sep 19, 2023
  
  ae473f79
- Update mgsm_cot_native_sw.yaml · d52d78aa
  Lintang Sutawika authored Sep 19, 2023
  
  d52d78aa
- Update mgsm_cot_native_ru.yaml · 5d5d53a7
  Lintang Sutawika authored Sep 19, 2023
  
  5d5d53a7
- Update mgsm_cot_native_ja.yaml · 7700d78a
  Lintang Sutawika authored Sep 19, 2023
  
  7700d78a
- Update mgsm_cot_native_fr.yaml · f7cff1ec
  Lintang Sutawika authored Sep 19, 2023
  
  f7cff1ec
- Update mgsm_cot_native_es.yaml · 58bef0be
  Lintang Sutawika authored Sep 19, 2023
  
  58bef0be
- Update mgsm_cot_native_de.yaml · b2eea396
  Lintang Sutawika authored Sep 19, 2023
  
  b2eea396
- Update mgsm_cot_native_en.yaml · 17190841
  Lintang Sutawika authored Sep 19, 2023
  
  17190841
- Update mgsm_cot_native_bn.yaml · feedaf08
  Lintang Sutawika authored Sep 19, 2023
  
  feedaf08
- Create cot_yaml · fa5ca8c3
  Lintang Sutawika authored Sep 19, 2023
```
Forgot this file
```
  fa5ca8c3
- format · a2009452
  lintangsutawika authored Sep 19, 2023
  
  a2009452
- added additional squad tasks · 4578ca14
  lintangsutawika authored Sep 19, 2023
  
  4578ca14
- moved benchmarks back to tasks/ · 1ed76cfa
  lintangsutawika authored Sep 19, 2023
  
  1ed76cfa
- Update __init__.py · 8daee342
  Lintang Sutawika authored Sep 19, 2023
  
  8daee342
18 Sep, 2023 6 commits
- raise exception if dependencies not met · 0e75f58c
  baberabb authored Sep 19, 2023
  
  0e75f58c
- update readme · 78a33749
  baberabb authored Sep 18, 2023
  
  78a33749
- type annotations 3.8 compatible · 30cedf0c
  baberabb authored Sep 18, 2023
  
  30cedf0c
- changes to promptsource output_type reverted · c6dc1ca4
  Hojjat Mokhtarabadi authored Sep 18, 2023
  
  c6dc1ca4
- format · 11be7c93
  lintangsutawika authored Sep 18, 2023
  
  11be7c93
- remove scrolls from this PR · d1c189ea
  lintangsutawika authored Sep 18, 2023
  
  d1c189ea
15 Sep, 2023 6 commits
- add ceval · 2d5d94da
  haileyschoelkopf authored Sep 15, 2023
  
  2d5d94da
- port csatqa to yaml · 020c4115
  haileyschoelkopf authored Sep 15, 2023
  
  020c4115
- update cmmlu readme · b29ef521
  haileyschoelkopf authored Sep 15, 2023
  
  b29ef521
- fix crows-pairs readme · 09ce0c02
  haileyschoelkopf authored Sep 15, 2023
  
  09ce0c02
- fix storycloze task name · b089e5f8
  haileyschoelkopf authored Sep 15, 2023
  
  b089e5f8
- add draft cmmlu port · 13c6f5e7
  haileyschoelkopf authored Sep 15, 2023
  
  13c6f5e7
14 Sep, 2023 5 commits
- refactored hendrycks_math to minerva_math · a554e41b
  baberabb authored Sep 15, 2023
  
  a554e41b
- add hendryck_math tasks; bugfixes · 1a34d084
  baberabb authored Sep 14, 2023
  
  1a34d084
- fix typo · b1dd5853
  haileyschoelkopf authored Sep 14, 2023
  
  b1dd5853
- Use Dict to make the code python 3.8 compatible · 38c9689a
  Chris authored Sep 14, 2023
  
  38c9689a
- change prompt formatting · 680c5686
  baberabb authored Sep 14, 2023
  
  680c5686
13 Sep, 2023 1 commit
- add qasper in scrolls · 020abc86
  lintangsutawika authored Sep 13, 2023
  
  020abc86
12 Sep, 2023 2 commits
- allow nested groups · f7d98500
  lintangsutawika authored Sep 12, 2023
  
  f7d98500
- fix typo · 5ebe28eb
  lintangsutawika authored Sep 12, 2023
  
  5ebe28eb
11 Sep, 2023 2 commits
- english cot, and added readable text in utils.py · e6939479
  lintangsutawika authored Sep 11, 2023
  
  e6939479
- update · c87703f3
  lintangsutawika authored Sep 11, 2023
  
  c87703f3