Commits · 622bdda1f07118cf297d7370572e7ee4ddf5e71e · gaoqiong / lm-evaluation-harness

"...nni_cmd/tests/config_files/invalid/searchspace-path.yml" did not exist on "69cae211e2790a14f5a0c667b4ac92daaad5ea00"

11 Jul, 2023 11 commits
- updated yamls · 622bdda1
  lintangsutawika authored Jul 11, 2023
  
  622bdda1
- fixed arc · 31c52f55
  lintangsutawika authored Jul 11, 2023
  
  31c52f55
- add ast.literal_eval to doc_to_choice · 155160a1
  lintangsutawika authored Jul 11, 2023
  
  155160a1
- process multiple_output · c37ad6ec
  lintangsutawika authored Jul 11, 2023
  
  c37ad6ec
- multiple_output option for greedy_until · 4c363ef8
  lintangsutawika authored Jul 11, 2023
  
  4c363ef8
- added error message · f09f3ab8
  lintangsutawika authored Jul 11, 2023
  
  f09f3ab8
- typo · 4054ab84
  lintangsutawika authored Jul 11, 2023
  
  4054ab84
- modified yamls · fc5a114f
  lintangsutawika authored Jul 11, 2023
  
  fc5a114f
- update choice process · 9b20e2d0
  lintangsutawika authored Jul 11, 2023
  
  9b20e2d0
- process update to process doc_to_target variety · 656c310e
  lintangsutawika authored Jul 11, 2023
  
  656c310e
- updated winogrande · 3b50b941
  lintangsutawika authored Jul 11, 2023
  
  3b50b941
10 Jul, 2023 3 commits
- Testing for multiple inputs from doc_to_text · f33c6c9b
  Lintang Sutawika authored Jul 10, 2023
  
  f33c6c9b
- template aliase process update. · 552b09e0
  Lintang Sutawika authored Jul 10, 2023
  
  552b09e0
- Changes in winogrande yaml · 9383f49e
  Lintang Sutawika authored Jul 10, 2023
  
  9383f49e
09 Jul, 2023 3 commits
- post_init to test if multple_choice has doc_to_text return list or str · 49a116ee
  Lintang Sutawika authored Jul 09, 2023
  
  49a116ee
- multple_choice handles 2 cases · 003c2581
  Lintang Sutawika authored Jul 09, 2023
  
  003c2581
- use prediction and prediction index · 87d93e99
  Lintang Sutawika authored Jul 09, 2023
  
  87d93e99
08 Jul, 2023 1 commit
- Very rough draft and scribbles · 3aeb95b6
  Lintang Sutawika authored Jul 09, 2023
  
  3aeb95b6
07 Jul, 2023 1 commit
- Update README.md · 884ba785
  Hailey Schoelkopf authored Jul 07, 2023
  
  884ba785
06 Jul, 2023 3 commits
- move race on HF to EleutherAI group · 31250b07
  ben authored Jul 06, 2023
  
  31250b07
- Update task statuses · fdcdc494
  Hailey Schoelkopf authored Jul 06, 2023
  
  fdcdc494
- Change `target_delimiter` to `fewshot_delimiter` · 7ffa1d1b
  Lintang Sutawika authored Jul 06, 2023
  
  7ffa1d1b
05 Jul, 2023 13 commits
- Update README.md · 29940d16
  Hailey Schoelkopf authored Jul 05, 2023
  
  29940d16
- Update README.md · 33add999
  Hailey Schoelkopf authored Jul 05, 2023
  
  33add999
- check off Lambada Multilingual from task list · b5697205
  haileyschoelkopf authored Jul 05, 2023
  
  b5697205
- remove batch_size param from config · 38bd2cc8
  haileyschoelkopf authored Jul 05, 2023
  
  38bd2cc8
- Update __init__.py · 797f47c7
  Lintang Sutawika authored Jul 05, 2023
  
  797f47c7
- remove unused line in evaluator.py · 23318d0e
  haileyschoelkopf authored Jul 05, 2023
  
  23318d0e
- fix typo in copa group name · 0e5da3b0
  haileyschoelkopf authored Jul 05, 2023
  
  0e5da3b0
- add lambada_mt tasks · 9735ac34
  haileyschoelkopf authored Jul 05, 2023
  
  9735ac34
- Update task.py · 59b047fb
  Lintang Sutawika authored Jul 05, 2023
  
  59b047fb
- Update task.py · 633fb458
  Lintang Sutawika authored Jul 05, 2023
  
  633fb458
- Update qa4mre status · 42c10bd6
  Hailey Schoelkopf authored Jul 05, 2023
  
  42c10bd6
- raise ValueError when invalid task passed · 7f557daa
  haileyschoelkopf authored Jul 05, 2023
  
  7f557daa
- list out answer choices · c7508401
  haileyschoelkopf authored Jul 05, 2023
  
  c7508401
04 Jul, 2023 5 commits
- revert utils black · 5a75f82a
  FarzanehNakhaee authored Jul 04, 2023
  
  5a75f82a
- black update · d75128dc
  FarzanehNakhaee authored Jul 04, 2023
  
  d75128dc
- resolve newline issue · dd584086
  FarzanehNakhaee authored Jul 04, 2023
  
  dd584086
- resolve new line error · ddc26f34
  FarzanehNakhaee authored Jul 04, 2023
  
  ddc26f34
- address PR comments · b1b5239d
  Benjamin Fattori authored Jul 04, 2023
  
  b1b5239d