Commits · 02362e6a2912e4083069df8078277ef91c24ada2 · gaoqiong / lm-evaluation-harness

05 Jul, 2023 7 commits
- Update README.md · 29940d16
  Hailey Schoelkopf authored Jul 05, 2023
  
  29940d16
- Update README.md · 33add999
  Hailey Schoelkopf authored Jul 05, 2023
  
  33add999
- check off Lambada Multilingual from task list · b5697205
  haileyschoelkopf authored Jul 05, 2023
  
  b5697205
- Update __init__.py · 797f47c7
  Lintang Sutawika authored Jul 05, 2023
  
  797f47c7
- fix typo in copa group name · 0e5da3b0
  haileyschoelkopf authored Jul 05, 2023
  
  0e5da3b0
- add lambada_mt tasks · 9735ac34
  haileyschoelkopf authored Jul 05, 2023
  
  9735ac34
- Update qa4mre status · 42c10bd6
  Hailey Schoelkopf authored Jul 05, 2023
  
  42c10bd6
04 Jul, 2023 3 commits
- Update __init__.py · d289277d
  Lintang Sutawika authored Jul 04, 2023
```
Should fix a potential error if a dataset has no `dataset_name` argument.

cc: @haileyschoelkopf
```
  d289277d
- Update doc to target and gold_alias in the config · e8bb77db
  FarzanehNakhaee authored Jul 04, 2023
  
  e8bb77db
- edit doc to text in yaml file · ccae768a
  FarzanehNakhaee authored Jul 04, 2023
  
  ccae768a
03 Jul, 2023 7 commits
- update task readme with completed race · 026d2c21
  Benjamin Fattori authored Jul 04, 2023
  
  026d2c21
- acc_norm not needed for pubmed_qa · 81bdd5bd
  Benjamin Fattori authored Jul 04, 2023
  
  81bdd5bd
- cleanup metric loading code · 328f0e85
  haileyschoelkopf authored Jul 03, 2023
  
  328f0e85
- update race preprocess + rename dataset · 2411c9d3
  Benjamin Fattori authored Jul 03, 2023
  
  2411c9d3
- add race task, with custom HF dataset · 7feab5e3
  Benjamin Fattori authored Jul 03, 2023
  
  7feab5e3
- Update README.md · 070b6b9c
  Hailey Schoelkopf authored Jul 03, 2023
  
  070b6b9c
- fixed super_glue and removed unused yaml config · 8737d53a
  lintangsutawika authored Jul 03, 2023
  
  8737d53a
02 Jul, 2023 2 commits
- update task readme for winogrande · 4b8e7ca7
  Benjamin Fattori authored Jul 02, 2023
  
  4b8e7ca7
- winogrande task implemented · d674c7bd
  Benjamin Fattori authored Jul 02, 2023
  
  d674c7bd
01 Jul, 2023 4 commits
- Update README.md · 28da615a
  Hailey Schoelkopf authored Jul 01, 2023
  
  28da615a
- Edit yaml file · 6cc461f5
  FarzanehNakhaee authored Jul 01, 2023
  
  6cc461f5
- Add newline · b88e3618
  FarzanehNakhaee authored Jul 01, 2023
  
  b88e3618
- Update README.md · 605964ad
  Hailey Schoelkopf authored Jun 30, 2023
  
  605964ad
30 Jun, 2023 3 commits
- [hellaswag] cast gold label to int · 8b9e5fa8
  nikuya3 authored Jul 01, 2023
  
  8b9e5fa8
- task readme updated for pubmed_qa · d9802303
  Benjamin Fattori authored Jun 30, 2023
  
  d9802303
- pubmed_qa implemented and tested · eb29b97b
  Benjamin Fattori authored Jun 30, 2023
  
  eb29b97b
29 Jun, 2023 7 commits
- update task readme for arithmetic · e50c8c70
  Benjamin Fattori authored Jun 29, 2023
  
  e50c8c70
- add arithmetic tasks · 470e33b1
  Benjamin Fattori authored Jun 29, 2023
  
  470e33b1
- update task readme for swag · 72c61866
  Benjamin Fattori authored Jun 29, 2023
  
  72c61866
- SWAG completed · a4b6f914
  Benjamin Fattori authored Jun 29, 2023
  
  a4b6f914
- Update README.md · a2e1d052
  Hailey Schoelkopf authored Jun 29, 2023
  
  a2e1d052
- Update task statuses on tracking list · 4d0ac35c
  Hailey Schoelkopf authored Jun 29, 2023
  
  4d0ac35c
- commit blank task yamls · 886190e9
  Benjamin Fattori authored Jun 29, 2023
  
  886190e9
26 Jun, 2023 1 commit
- update delimiter->fewshot_delimiter · 89a5a865
  haileyschoelkopf authored Jun 26, 2023
  
  89a5a865
22 Jun, 2023 4 commits
- added for seq2seq greedy_until test · 6122efac
  lintangsutawika authored Jun 22, 2023
  
  6122efac
- rename boolq task name for testing · 6d8cdef8
  lintangsutawika authored Jun 22, 2023
  
  6d8cdef8
- more pre-commit · b48f5205
  haileyschoelkopf authored Jun 20, 2023
  
  b48f5205
- allow include_task_folder to use non-leaf dir YAML files · 6d36a9c9
  haileyschoelkopf authored Jun 20, 2023
  
  6d36a9c9
21 Jun, 2023 2 commits
- Trim white spaces and restore correct order in hellaswag preprocessing · 5be6a53d
  nikuya3 authored Jun 21, 2023
  
  5be6a53d
- reformat · 3c895d56
  lintangsutawika authored Jun 21, 2023
  
  3c895d56