Commits · e0417b3bea73c2fabb3cdc8cb1029ffd79be3512 · gaoqiong / lm-evaluation-harness

12 Jul, 2023 1 commit
- Update evaluator.py · 907c99c0
  Hailey Schoelkopf authored Jul 12, 2023
  
  907c99c0
07 Jul, 2023 3 commits
- add MWP tag to mathQA · 76bf11c5
  haileyschoelkopf authored Jul 07, 2023
  
  76bf11c5
- add mathqa · 255f4c6e
  haileyschoelkopf authored Jul 07, 2023
  
  255f4c6e
- Update README.md · 884ba785
  Hailey Schoelkopf authored Jul 07, 2023
  
  884ba785
06 Jul, 2023 8 commits
- add hendrycks ethics · aa60d2b6
  haileyschoelkopf authored Jul 06, 2023
  
  aa60d2b6
- revert change to template_aliases · 6fc2e148
  haileyschoelkopf authored Jul 06, 2023
  
  6fc2e148
- move race on HF to EleutherAI group · 31250b07
  ben authored Jul 06, 2023
  
  31250b07
- Update task statuses · fdcdc494
  Hailey Schoelkopf authored Jul 06, 2023
  
  fdcdc494
- change Prost task name to match old ver. · dcb16263
  haileyschoelkopf authored Jul 06, 2023
  
  dcb16263
- fix bug in gsm8k · a4b0eafe
  haileyschoelkopf authored Jul 06, 2023
  
  a4b0eafe
- bugfixes + add write_out · 4e5a328e
  haileyschoelkopf authored Jul 06, 2023
  
  4e5a328e
- Change `target_delimiter` to `fewshot_delimiter` · 7ffa1d1b
  Lintang Sutawika authored Jul 06, 2023
  
  7ffa1d1b
05 Jul, 2023 18 commits
- update task statuses · e071dd5e
  haileyschoelkopf authored Jul 05, 2023
  
  e071dd5e
- push unscramble · 7a76696e
  haileyschoelkopf authored Jul 05, 2023
  
  7a76696e
- add toxigen task (confirmed working) · d93a96b4
  haileyschoelkopf authored Jul 05, 2023
  
  d93a96b4
- Update README.md · 29940d16
  Hailey Schoelkopf authored Jul 05, 2023
  
  29940d16
- Update README.md · 33add999
  Hailey Schoelkopf authored Jul 05, 2023
  
  33add999
- add headqa · 3ab3c388
  haileyschoelkopf authored Jul 05, 2023
  
  3ab3c388
- remove acc_mutual_info · 80a0302a
  haileyschoelkopf authored Jul 05, 2023
  
  80a0302a
- check off Lambada Multilingual from task list · b5697205
  haileyschoelkopf authored Jul 05, 2023
  
  b5697205
- remove batch_size param from config · 38bd2cc8
  haileyschoelkopf authored Jul 05, 2023
  
  38bd2cc8
- Update __init__.py · 797f47c7
  Lintang Sutawika authored Jul 05, 2023
  
  797f47c7
- remove unused line in evaluator.py · 23318d0e
  haileyschoelkopf authored Jul 05, 2023
  
  23318d0e
- fix typo in copa group name · 0e5da3b0
  haileyschoelkopf authored Jul 05, 2023
  
  0e5da3b0
- add lambada_mt tasks · 9735ac34
  haileyschoelkopf authored Jul 05, 2023
  
  9735ac34
- Update task.py · 59b047fb
  Lintang Sutawika authored Jul 05, 2023
  
  59b047fb
- Update task.py · 633fb458
  Lintang Sutawika authored Jul 05, 2023
  
  633fb458
- Update qa4mre status · 42c10bd6
  Hailey Schoelkopf authored Jul 05, 2023
  
  42c10bd6
- raise ValueError when invalid task passed · 7f557daa
  haileyschoelkopf authored Jul 05, 2023
  
  7f557daa
- list out answer choices · c7508401
  haileyschoelkopf authored Jul 05, 2023
  
  c7508401
04 Jul, 2023 10 commits
- revert utils black · 5a75f82a
  FarzanehNakhaee authored Jul 04, 2023
  
  5a75f82a
- black update · d75128dc
  FarzanehNakhaee authored Jul 04, 2023
  
  d75128dc
- resolve newline issue · dd584086
  FarzanehNakhaee authored Jul 04, 2023
  
  dd584086
- resolve new line error · ddc26f34
  FarzanehNakhaee authored Jul 04, 2023
  
  ddc26f34
- address PR comments · b1b5239d
  Benjamin Fattori authored Jul 04, 2023
  
  b1b5239d
- Upload qa4mre_2013 · e6a8846c
  FarzanehNakhaee authored Jul 04, 2023
  
  e6a8846c
- Upload qa4mre_2012 · 09459176
  FarzanehNakhaee authored Jul 04, 2023
  
  09459176
- Update __init__.py · d289277d
  Lintang Sutawika authored Jul 04, 2023
```
Should fix a potential error if a dataset has no `dataset_name` argument.

cc: @haileyschoelkopf
```
  d289277d
- Update doc to target and gold_alias in the config · e8bb77db
  FarzanehNakhaee authored Jul 04, 2023
  
  e8bb77db
- edit doc to text in yaml file · ccae768a
  FarzanehNakhaee authored Jul 04, 2023
  
  ccae768a