Commits · 5fbc3f86c1768d8b9d849a2aa914d2be453208fe · gaoqiong / lm-evaluation-harness

14 Jul, 2023 1 commit
- fix random seed issue, log_samples optional · 5fbc3f86
  haileyschoelkopf authored Jul 14, 2023
  
  5fbc3f86
13 Jul, 2023 3 commits
- log all arguments per doc · 09a71562
  haileyschoelkopf authored Jul 13, 2023
  
  09a71562
- add fast tokenizer flag · 165f8493
  haileyschoelkopf authored Jul 13, 2023
  
  165f8493
- Update README.md · 98c85d73
  Hailey Schoelkopf authored Jul 13, 2023
  
  98c85d73
12 Jul, 2023 2 commits
- Update README.md · 027efa00
  Hailey Schoelkopf authored Jul 12, 2023
  
  027efa00
- Update evaluator.py · 907c99c0
  Hailey Schoelkopf authored Jul 12, 2023
  
  907c99c0
08 Jul, 2023 2 commits
- Update task checklist · a09e04bc
  nopperl authored Jul 08, 2023
  
  a09e04bc
- Port truthfulqa mc1 task · 5af4a867
  nopperl authored Jul 08, 2023
  
  5af4a867
07 Jul, 2023 3 commits
- add MWP tag to mathQA · 76bf11c5
  haileyschoelkopf authored Jul 07, 2023
  
  76bf11c5
- add mathqa · 255f4c6e
  haileyschoelkopf authored Jul 07, 2023
  
  255f4c6e
- Update README.md · 884ba785
  Hailey Schoelkopf authored Jul 07, 2023
  
  884ba785
06 Jul, 2023 8 commits
- add hendrycks ethics · aa60d2b6
  haileyschoelkopf authored Jul 06, 2023
  
  aa60d2b6
- revert change to template_aliases · 6fc2e148
  haileyschoelkopf authored Jul 06, 2023
  
  6fc2e148
- move race on HF to EleutherAI group · 31250b07
  ben authored Jul 06, 2023
  
  31250b07
- Update task statuses · fdcdc494
  Hailey Schoelkopf authored Jul 06, 2023
  
  fdcdc494
- change Prost task name to match old ver. · dcb16263
  haileyschoelkopf authored Jul 06, 2023
  
  dcb16263
- fix bug in gsm8k · a4b0eafe
  haileyschoelkopf authored Jul 06, 2023
  
  a4b0eafe
- bugfixes + add write_out · 4e5a328e
  haileyschoelkopf authored Jul 06, 2023
  
  4e5a328e
- Change `target_delimiter` to `fewshot_delimiter` · 7ffa1d1b
  Lintang Sutawika authored Jul 06, 2023
  
  7ffa1d1b
05 Jul, 2023 18 commits
- update task statuses · e071dd5e
  haileyschoelkopf authored Jul 05, 2023
  
  e071dd5e
- push unscramble · 7a76696e
  haileyschoelkopf authored Jul 05, 2023
  
  7a76696e
- add toxigen task (confirmed working) · d93a96b4
  haileyschoelkopf authored Jul 05, 2023
  
  d93a96b4
- Update README.md · 29940d16
  Hailey Schoelkopf authored Jul 05, 2023
  
  29940d16
- Update README.md · 33add999
  Hailey Schoelkopf authored Jul 05, 2023
  
  33add999
- add headqa · 3ab3c388
  haileyschoelkopf authored Jul 05, 2023
  
  3ab3c388
- remove acc_mutual_info · 80a0302a
  haileyschoelkopf authored Jul 05, 2023
  
  80a0302a
- check off Lambada Multilingual from task list · b5697205
  haileyschoelkopf authored Jul 05, 2023
  
  b5697205
- remove batch_size param from config · 38bd2cc8
  haileyschoelkopf authored Jul 05, 2023
  
  38bd2cc8
- Update __init__.py · 797f47c7
  Lintang Sutawika authored Jul 05, 2023
  
  797f47c7
- remove unused line in evaluator.py · 23318d0e
  haileyschoelkopf authored Jul 05, 2023
  
  23318d0e
- fix typo in copa group name · 0e5da3b0
  haileyschoelkopf authored Jul 05, 2023
  
  0e5da3b0
- add lambada_mt tasks · 9735ac34
  haileyschoelkopf authored Jul 05, 2023
  
  9735ac34
- Update task.py · 59b047fb
  Lintang Sutawika authored Jul 05, 2023
  
  59b047fb
- Update task.py · 633fb458
  Lintang Sutawika authored Jul 05, 2023
  
  633fb458
- Update qa4mre status · 42c10bd6
  Hailey Schoelkopf authored Jul 05, 2023
  
  42c10bd6
- raise ValueError when invalid task passed · 7f557daa
  haileyschoelkopf authored Jul 05, 2023
  
  7f557daa
- list out answer choices · c7508401
  haileyschoelkopf authored Jul 05, 2023
  
  c7508401
04 Jul, 2023 3 commits
- revert utils black · 5a75f82a
  FarzanehNakhaee authored Jul 04, 2023
  
  5a75f82a
- black update · d75128dc
  FarzanehNakhaee authored Jul 04, 2023
  
  d75128dc
- resolve newline issue · dd584086
  FarzanehNakhaee authored Jul 04, 2023
  
  dd584086