Commits · 070b6b9c1286d5a62e6f53fab285de46feefd46e · gaoqiong / lm-evaluation-harness

03 Jul, 2023 2 commits
- Update README.md · 070b6b9c
  Hailey Schoelkopf authored Jul 03, 2023
  
  070b6b9c
- fixed super_glue and removed unused yaml config · 8737d53a
  lintangsutawika authored Jul 03, 2023
  
  8737d53a
01 Jul, 2023 2 commits
- Update README.md · 28da615a
  Hailey Schoelkopf authored Jul 01, 2023
  
  28da615a
- Update README.md · 605964ad
  Hailey Schoelkopf authored Jun 30, 2023
  
  605964ad
30 Jun, 2023 1 commit
- [hellaswag] cast gold label to int · 8b9e5fa8
  nikuya3 authored Jul 01, 2023
  
  8b9e5fa8
29 Jun, 2023 2 commits
- Update README.md · a2e1d052
  Hailey Schoelkopf authored Jun 29, 2023
  
  a2e1d052
- Update task statuses on tracking list · 4d0ac35c
  Hailey Schoelkopf authored Jun 29, 2023
  
  4d0ac35c
26 Jun, 2023 1 commit
- update delimiter->fewshot_delimiter · 89a5a865
  haileyschoelkopf authored Jun 26, 2023
  
  89a5a865
22 Jun, 2023 4 commits
- added for seq2seq greedy_until test · 6122efac
  lintangsutawika authored Jun 22, 2023
  
  6122efac
- rename boolq task name for testing · 6d8cdef8
  lintangsutawika authored Jun 22, 2023
  
  6d8cdef8
- more pre-commit · b48f5205
  haileyschoelkopf authored Jun 20, 2023
  
  b48f5205
- allow include_task_folder to use non-leaf dir YAML files · 6d36a9c9
  haileyschoelkopf authored Jun 20, 2023
  
  6d36a9c9
21 Jun, 2023 8 commits
- Trim white spaces and restore correct order in hellaswag preprocessing · 5be6a53d
  nikuya3 authored Jun 21, 2023
  
  5be6a53d
- reformat · 3c895d56
  lintangsutawika authored Jun 21, 2023
  
  3c895d56
- Update hellaswag.yaml · 3262fb74
  Lintang Sutawika authored Jun 21, 2023
  
  3262fb74
- Preprocess answer choices of hellaswag task · 25dcf333
  nikuya3 authored Jun 21, 2023
  
  25dcf333
- Do not ignore task directories with __pycache__ subdirectories · 6e482e5b
  nikuya3 authored Jun 20, 2023
  
  6e482e5b
- Port hellaswag task · db6912a8
  nikuya3 authored Jun 20, 2023
  
  db6912a8
- Update hellaswag.yaml · dafc7529
  Lintang Sutawika authored Jun 21, 2023
  
  dafc7529
- Preprocess answer choices of hellaswag task · bec2b500
  nikuya3 authored Jun 21, 2023
  
  bec2b500
20 Jun, 2023 6 commits
- fix accuracy -> acc for lambada · 6ee8e4e3
  haileyschoelkopf authored Jun 20, 2023
  
  6ee8e4e3
- remove old code · cbb04a20
  haileyschoelkopf authored Jun 20, 2023
  
  cbb04a20
- more pre-commit · 9cf4a104
  haileyschoelkopf authored Jun 20, 2023
  
  9cf4a104
- allow include_task_folder to use non-leaf dir YAML files · e8c84a38
  haileyschoelkopf authored Jun 20, 2023
  
  e8c84a38
- Do not ignore task directories with __pycache__ subdirectories · 33c482ef
  nikuya3 authored Jun 20, 2023
  
  33c482ef
- Port hellaswag task · 10a2ccca
  nikuya3 authored Jun 20, 2023
  
  10a2ccca
19 Jun, 2023 2 commits
- misc fixes · 3f0afe02
  haileyschoelkopf authored Jun 19, 2023
  
  3f0afe02
- Update checklist for OBQA · 41677741
  Hailey Schoelkopf authored Jun 19, 2023
  
  41677741
18 Jun, 2023 1 commit
- add openbookqa config · aa0326e3
  FarzanehNakhaee authored Jun 18, 2023
  
  aa0326e3
16 Jun, 2023 2 commits
- update docs + rest of mcqa tasks · de21abbd
  haileyschoelkopf authored Jun 16, 2023
  
  de21abbd
- fixes for multiple_choice · 4e72f165
  lintangsutawika authored Jun 16, 2023
  
  4e72f165
15 Jun, 2023 5 commits
- Delete triviaqa.py · c7572ba6
  Hailey Schoelkopf authored Jun 15, 2023
  
  c7572ba6
- Delete gsm8k.py · 025fa6e8
  Hailey Schoelkopf authored Jun 15, 2023
  
  025fa6e8
- Update __init__.py · 2db1e7cb
  Hailey Schoelkopf authored Jun 15, 2023
  
  2db1e7cb
- Update README.md · f637b876
  Hailey Schoelkopf authored Jun 15, 2023
  
  f637b876
- minor fixes to satisify pre-commit · 400c0199
  lintangsutawika authored Jun 15, 2023
  
  400c0199
14 Jun, 2023 4 commits
- Update triviaqa.py · 50cf0984
  Hailey Schoelkopf authored Jun 14, 2023
  
  50cf0984
- Update __init__.py · ced29179
  Lintang Sutawika authored Jun 14, 2023
  
  ced29179
- Change triviaqa dataset path · a1160392
  Hailey Schoelkopf authored Jun 14, 2023
  
  a1160392
- Change accuracy to acc · 346be595
  FarzanehNakhaee authored Jun 14, 2023
  
  346be595