Commits · f720ce816bfc9d2bd6c5d2b1af6e8d7c5d948c41 · gaoqiong / lm-evaluation-harness

15 May, 2024 4 commits
- removed utils · c56593ee
  Israel Abebe Azime authored May 15, 2024
  
  c56593ee
- update on afrimgsm · 094a17d6
  Israel Abebe Azime authored May 15, 2024
  
  094a17d6
- update on afrimgsm · 224e9046
  Israel Abebe Azime authored May 15, 2024
  
  224e9046
- modefied mgsm · cb979e6c
  Israel Abebe Azime authored May 15, 2024
  
  cb979e6c
14 May, 2024 9 commits
- format task name, clean ups · c91e7fe5
  JessicaOjo authored May 14, 2024
  
  c91e7fe5
- add utility · 5ba791e2
  JessicaOjo authored May 14, 2024
  
  5ba791e2
- remove afrimmlu_translate folder · 3290b2b9
  JessicaOjo authored May 14, 2024
  
  3290b2b9
- spacing · 5518b9fa
  JessicaOjo authored May 14, 2024
  
  5518b9fa
- restructure mmlu folder · 47d8de5a
  JessicaOjo authored May 14, 2024
  
  47d8de5a
- fix exact match valueError · 065d91bb
  JessicaOjo authored May 14, 2024
  
  065d91bb
- fix exact match valueError · b91cabae
  JessicaOjo authored May 14, 2024
  
  b91cabae
- added afrixnli_translate · c1ed7068
  Israel Abebe Azime authored May 14, 2024
  
  c1ed7068
- added translate test · 554846a4
  Israel Abebe Azime authored May 14, 2024
  
  554846a4
13 May, 2024 10 commits
- add squad metric to mgsm, remove whitespace filter · 03ebd203
  JessicaOjo authored May 13, 2024
  
  03ebd203
- change eng to ewe in ewe yaml mmlu · e02732be
  JessicaOjo authored May 13, 2024
  
  e02732be
- Adding tinyBenchmarks datasets (#1545) · fe9fef4e
  Lucas Weber authored May 13, 2024
```
* Add tinyBenchmarks

* Add acknowledgements

* Add ordering of outputs for data-parallel

* Run pre-commit

* Add few_shot specifications

* Add tinyBenchmarks post-processing

* add conditional import ; fix task names

---------
Co-authored-by: haileyschoelkopf <hailey@eleuther.ai>
```
  fe9fef4e
- add swahili to mmlu · 63d328fe
  JessicaOjo authored May 13, 2024
  
  63d328fe
- remove test configs · 3664097f
  JessicaOjo authored May 13, 2024
  
  3664097f
- remove test limit · 6031d7d7
  JessicaOjo authored May 13, 2024
  
  6031d7d7
- add utils · 2a285714
  JessicaOjo authored May 13, 2024
  
  2a285714
- add lin to utils · dade45c6
  JessicaOjo authored May 13, 2024
  
  dade45c6
- change f1 function · 909b7b33
  JessicaOjo authored May 13, 2024
  
  909b7b33
- update native-direct with lin · 9af86259
  JessicaOjo authored May 13, 2024
  
  9af86259
12 May, 2024 10 commits
- add f1 score to mgsm · 5d662de1
  JessicaOjo authored May 12, 2024
  
  5d662de1
- add f1 score to mgsm · d66d6ca1
  JessicaOjo authored May 12, 2024
  
  d66d6ca1
- remove squad metric · 58692fb5
  JessicaOjo authored May 12, 2024
  
  58692fb5
- remove squad metric · 052c7bde
  JessicaOjo authored May 12, 2024
  
  052c7bde
- filter and metric fix -mgsm · fef54568
  JessicaOjo authored May 12, 2024
  
  fef54568
- prompt translations fix · b691c952
  JessicaOjo authored May 12, 2024
  
  b691c952
- prompt translations fix · 6c8d4053
  JessicaOjo authored May 12, 2024
  
  6c8d4053
- update metrics for afrixnli · a3953e0f
  JessicaOjo authored May 12, 2024
  
  a3953e0f
- update afrixnli tasks · b5067932
  JessicaOjo authored May 12, 2024
  
  b5067932
- update afrixnli tasks · b84c8c9e
  JessicaOjo authored May 12, 2024
  
  b84c8c9e
10 May, 2024 7 commits
- added transate test · 452d2024
  Israel Abebe Azime authored May 10, 2024
  
  452d2024
- fix direct path, add bash script for gpt models · bcee8f2e
  JessicaOjo authored May 10, 2024
  
  bcee8f2e
- add few show. metric fixes · c4f634c6
  JessicaOjo authored May 10, 2024
  
  c4f634c6
- remove print · ae6e5cbd
  JessicaOjo authored May 10, 2024
  
  ae6e5cbd
- remove direct util, update common yaml · 3eab4b9a
  JessicaOjo authored May 10, 2024
  
  3eab4b9a
- fix bash script · 21fb0db7
  JessicaOjo authored May 10, 2024
  
  21fb0db7
- add squad metric · 6ca56eac
  JessicaOjo authored May 10, 2024
  
  6ca56eac