Commits · 86e785899d703bd2edc37df2e7e872220f3fb2cf · gaoqiong / lm-evaluation-harness

04 Sep, 2023 6 commits
- modified changes to fix loglikelihood prediction for seq2seq · 86e78589
  lintangsutawika authored Sep 04, 2023
  
  86e78589
- add flan_zeroshot · 0d195e90
  lintangsutawika authored Sep 04, 2023
  
  0d195e90
- add flan_fewshot · 3531d9c1
  lintangsutawika authored Sep 04, 2023
  
  3531d9c1
- add flan_cot_zeroshot · c06b0d6e
  lintangsutawika authored Sep 04, 2023
  
  c06b0d6e
- add bbh flan_cot_fewshot · 13940f1e
  lintangsutawika authored Sep 04, 2023
  
  13940f1e
- update · 06d3406e
  lintangsutawika authored Sep 04, 2023
  
  06d3406e
03 Sep, 2023 1 commit
- add mmlu variants · f23ae748
  lintangsutawika authored Sep 03, 2023
  
  f23ae748
01 Sep, 2023 1 commit
- edit stop token · a81ef1a7
  lintangsutawika authored Sep 01, 2023
  
  a81ef1a7
31 Aug, 2023 1 commit
- update to generate bbh configs · c3764d2c
  lintangsutawika authored Aug 31, 2023
  
  c3764d2c
30 Aug, 2023 13 commits
- added more flan subtasks · 525f1d15
  lintangsutawika authored Aug 30, 2023
  
  525f1d15
- add bbh · 24754ee4
  lintangsutawika authored Aug 30, 2023
  
  24754ee4
- Update task.py · ebfff08f
  Lintang Sutawika authored Aug 30, 2023
  
  ebfff08f
- Update task.py · 8d1d003d
  Lintang Sutawika authored Aug 30, 2023
  
  8d1d003d
- checked coqa on readme · 8287fe7c
  lintangsutawika authored Aug 30, 2023
  
  8287fe7c
- fix formatting · f555a583
  lintangsutawika authored Aug 30, 2023
  
  f555a583
- running process for drop · 79aa53b1
  lintangsutawika authored Aug 30, 2023
  
  79aa53b1
- add coqa · 64d4600c
  lintangsutawika authored Aug 30, 2023
  
  64d4600c
- add drop · f9558ce5
  lintangsutawika authored Aug 30, 2023
  
  f9558ce5
- reformat · cddbf9f6
  lintangsutawika authored Aug 30, 2023
  
  cddbf9f6
- added checks for if gold is outside choice options · 65e5bc69
  lintangsutawika authored Aug 30, 2023
  
  65e5bc69
- moved benchmark up · c0cb0be7
  lintangsutawika authored Aug 30, 2023
  
  c0cb0be7
- updated yaml templates · 0a5bd869
  lintangsutawika authored Aug 30, 2023
  
  0a5bd869
29 Aug, 2023 4 commits
- moved templates, edit templates · 7e875dcf
  lintangsutawika authored Aug 29, 2023
  
  7e875dcf
- added subtasks · db79d927
  lintangsutawika authored Aug 29, 2023
  
  db79d927
- udpated to work · 4bdf11e1
  lintangsutawika authored Aug 29, 2023
  
  4bdf11e1
- expanded benchmark to allow new source of prompt templates · d1c3cb3d
  lintangsutawika authored Aug 29, 2023
  
  d1c3cb3d
28 Aug, 2023 6 commits
- Delete dataset_infos.json · 25a667f5
  Lintang Sutawika authored Aug 29, 2023
  
  25a667f5
- Delete asdiv.py · 1b3330f3
  Lintang Sutawika authored Aug 29, 2023
  
  1b3330f3
- Delete __init__.py · 79b6434b
  Lintang Sutawika authored Aug 29, 2023
  
  79b6434b
- Delete __init__.py · ddfcb1fd
  Lintang Sutawika authored Aug 29, 2023
  
  ddfcb1fd
- Delete README.md · 94011b10
  Lintang Sutawika authored Aug 29, 2023
  
  94011b10
- Update default.yaml · 8817b561
  Lintang Sutawika authored Aug 29, 2023
  
  8817b561
27 Aug, 2023 1 commit
- format · 3768b1c4
  lintangsutawika authored Aug 27, 2023
  
  3768b1c4
26 Aug, 2023 2 commits
- add yaml · 648dcef1
  lintangsutawika authored Aug 26, 2023
  
  648dcef1
- add asdiv task · 69a08222
  lintangsutawika authored Aug 26, 2023
  
  69a08222
25 Aug, 2023 5 commits
- removed unused line · b7082722
  lintangsutawika authored Aug 25, 2023
  
  b7082722
- add benchmark with t5x · 5aec6f26
  lintangsutawika authored Aug 25, 2023
  
  5aec6f26
- added info · 1d77a7b8
  lintangsutawika authored Aug 25, 2023
  
  1d77a7b8
- reformat · ec4bc493
  lintangsutawika authored Aug 25, 2023
  
  ec4bc493
- fixed group to int · a3eb6393
  lintangsutawika authored Aug 25, 2023
  
  a3eb6393