Commits · b8faaa93144f223914b028b6684c8845e563f49d · gaoqiong / lm-evaluation-harness

04 Oct, 2023 6 commits
- fix wildcards · 09d935ee
  haileyschoelkopf authored Oct 04, 2023
  
  09d935ee
- change back to original dataset path · 51a43a76
  haileyschoelkopf authored Oct 04, 2023
  
  51a43a76
- change back to original dataset path · 54498fcc
  haileyschoelkopf authored Oct 04, 2023
  
  54498fcc
- move to __main__.py · 3b5e554f
  haileyschoelkopf authored Oct 04, 2023
  
  3b5e554f
- moved main to lm_eval/ to fix import of main error · 6f92c20d
  lintangsutawika authored Oct 04, 2023
  
  6f92c20d
- modify default yamls · 7e6e3c20
  haileyschoelkopf authored Oct 04, 2023
  
  7e6e3c20
03 Oct, 2023 5 commits
- add bigbench push_to_hub script · 67c0f73a
  haileyschoelkopf authored Oct 03, 2023
  
  67c0f73a
- add bigbench push_to_hub script · fa608798
  haileyschoelkopf authored Oct 03, 2023
  
  fa608798
- push updated bigbench task yamls · 8806944e
  haileyschoelkopf authored Oct 03, 2023
  
  8806944e
- update generate_tasks.py and template yamls · 1a77b4d5
  haileyschoelkopf authored Oct 03, 2023
  
  1a77b4d5
- Bring task name to `pubmedqa` in line with master branch · 3a7f52d0
  Hailey Schoelkopf authored Oct 03, 2023
  
  3a7f52d0
29 Sep, 2023 2 commits
- Update preprocess_pubmedqa.py · 6658f510
  Tanishq Abraham authored Sep 29, 2023
  
  6658f510
- Update pubmedqa.yaml · 5c418e2e
  Tanishq Abraham authored Sep 29, 2023
  
  5c418e2e
22 Sep, 2023 3 commits
- trigger precommit · d98159b2
  haileyschoelkopf authored Sep 22, 2023
  
  d98159b2
- trigger precommit · e4aa240e
  haileyschoelkopf authored Sep 22, 2023
  
  e4aa240e
- hotfix bugs · 43c91b5c
  haileyschoelkopf authored Sep 22, 2023
  
  43c91b5c
21 Sep, 2023 3 commits
- Note [math] extra · c8f56b17
  Hailey Schoelkopf authored Sep 21, 2023
  
  c8f56b17
- Create README.md · 7418eddd
  Lintang Sutawika authored Sep 21, 2023
  
  7418eddd
- Fix positional arguments in HF model generate · 877e9a61
  Chris authored Sep 21, 2023
  
  877e9a61
19 Sep, 2023 17 commits
- fixed task and benchmark adding process · f921fc19
  lintangsutawika authored Sep 19, 2023
  
  f921fc19
- Update mgsm_cot_native_zh.yaml · 4a967f26
  Lintang Sutawika authored Sep 19, 2023
  
  4a967f26
- Update mgsm_cot_native_th.yaml · 0f2ff6af
  Lintang Sutawika authored Sep 19, 2023
  
  0f2ff6af
- Update mgsm_cot_native_te.yaml · ae473f79
  Lintang Sutawika authored Sep 19, 2023
  
  ae473f79
- Update mgsm_cot_native_sw.yaml · d52d78aa
  Lintang Sutawika authored Sep 19, 2023
  
  d52d78aa
- Update mgsm_cot_native_ru.yaml · 5d5d53a7
  Lintang Sutawika authored Sep 19, 2023
  
  5d5d53a7
- Update mgsm_cot_native_ja.yaml · 7700d78a
  Lintang Sutawika authored Sep 19, 2023
  
  7700d78a
- Update mgsm_cot_native_fr.yaml · f7cff1ec
  Lintang Sutawika authored Sep 19, 2023
  
  f7cff1ec
- Update mgsm_cot_native_es.yaml · 58bef0be
  Lintang Sutawika authored Sep 19, 2023
  
  58bef0be
- Update mgsm_cot_native_de.yaml · b2eea396
  Lintang Sutawika authored Sep 19, 2023
  
  b2eea396
- Update mgsm_cot_native_en.yaml · 17190841
  Lintang Sutawika authored Sep 19, 2023
  
  17190841
- Update mgsm_cot_native_bn.yaml · feedaf08
  Lintang Sutawika authored Sep 19, 2023
  
  feedaf08
- Create cot_yaml · fa5ca8c3
  Lintang Sutawika authored Sep 19, 2023
```
Forgot this file
```
  fa5ca8c3
- format · a2009452
  lintangsutawika authored Sep 19, 2023
  
  a2009452
- added additional squad tasks · 4578ca14
  lintangsutawika authored Sep 19, 2023
  
  4578ca14
- moved benchmarks back to tasks/ · 1ed76cfa
  lintangsutawika authored Sep 19, 2023
  
  1ed76cfa
- Update __init__.py · 8daee342
  Lintang Sutawika authored Sep 19, 2023
  
  8daee342
18 Sep, 2023 4 commits
- raise exception if dependencies not met · 0e75f58c
  baberabb authored Sep 19, 2023
  
  0e75f58c
- update readme · 78a33749
  baberabb authored Sep 18, 2023
  
  78a33749
- type annotations 3.8 compatible · 30cedf0c
  baberabb authored Sep 18, 2023
  
  30cedf0c
- changes to promptsource output_type reverted · c6dc1ca4
  Hojjat Mokhtarabadi authored Sep 18, 2023
  
  c6dc1ca4