Commits · c21240c0a9b68f5845e8705aeb5326b17da2d3bb · gaoqiong / lm-evaluation-harness

17 Nov, 2023 5 commits
- update bigbench datasets to mirror, rename groupnames · 487767ab
  haileyschoelkopf authored Nov 17, 2023
  
  487767ab
- precommit · f40b7d0e
  lintangsutawika authored Nov 17, 2023
  
  f40b7d0e
- edits and format · 10cc0a56
  lintangsutawika authored Nov 17, 2023
  
  10cc0a56
- added alternative prompts for mathqa · bbd6ab3a
  lintangsutawika authored Nov 17, 2023
  
  bbd6ab3a
- added alternative prompts for hellaswag · 7cd1555e
  lintangsutawika authored Nov 17, 2023
  
  7cd1555e
15 Nov, 2023 1 commit
- update squad file · c9a3fd3f
  lintangsutawika authored Nov 15, 2023
  
  c9a3fd3f
14 Nov, 2023 2 commits
- add task_alias · f8740ff4
  lintangsutawika authored Nov 14, 2023
  
  f8740ff4
- alternative prompts for arithmetic · c25f6a31
  lintangsutawika authored Nov 14, 2023
  
  c25f6a31
10 Nov, 2023 2 commits
- fixes · 69186ef2
  lintangsutawika authored Nov 10, 2023
  
  69186ef2
- added initialize_task and updated where eval_logger is imported from · 056c9d85
  lintangsutawika authored Nov 10, 2023
  
  056c9d85
09 Nov, 2023 7 commits
- updates to scrolls · 51753750
  lintangsutawika authored Nov 09, 2023
  
  51753750
- reformat · 097c9253
  lintangsutawika authored Nov 09, 2023
  
  097c9253
- reformat · 6c812bb5
  lintangsutawika authored Nov 09, 2023
  
  6c812bb5
- reformat · 9a64e642
  lintangsutawika authored Nov 09, 2023
  
  9a64e642
- add scrolls · 75137836
  lintangsutawika authored Nov 09, 2023
  
  75137836
- readded task descriptions · a3520619
  lintangsutawika authored Nov 09, 2023
  
  a3520619
- merged cont-metrics here · 6998762a
  lintangsutawika authored Nov 09, 2023
  
  6998762a
08 Nov, 2023 4 commits
- Update generate_until_template_yaml · 1522009c
  Lintang Sutawika authored Nov 08, 2023
  
  1522009c
- removed yaml version of squad · d3f429ac
  lintangsutawika authored Nov 08, 2023
  
  d3f429ac
- removed yaml version of squad · 9817e7c2
  lintangsutawika authored Nov 08, 2023
  
  9817e7c2
- added comment line · 7b60ead4
  lintangsutawika authored Nov 08, 2023
  
  7b60ead4
07 Nov, 2023 4 commits
- moved squad.py and format changes · e1d5c849
  lintangsutawika authored Nov 07, 2023
  
  e1d5c849
- add squad from master · 8bf55a20
  lintangsutawika authored Nov 07, 2023
  
  8bf55a20
- format · 0a39d055
  lintangsutawika authored Nov 07, 2023
  
  0a39d055
- add TED to BigBench and Brier score to MMLU · 2b7d8c2d
  lintangsutawika authored Nov 07, 2023
  
  2b7d8c2d
03 Nov, 2023 3 commits
- fix gsm8k regexes · 93d088c8
  haileyschoelkopf authored Nov 03, 2023
  
  93d088c8
- Update _generate_configs.py · 4d9b928e
  Hailey Schoelkopf authored Nov 03, 2023
  
  4d9b928e
- remove gold_alias from codebase · 37ac5f46
  haileyschoelkopf authored Nov 03, 2023
  
  37ac5f46
02 Nov, 2023 5 commits
- precommit format · 73f3029c
  lintangsutawika authored Nov 02, 2023
  
  73f3029c
- eval_logger is not imported from logger.py anymore · f701ba7d
  lintangsutawika authored Nov 02, 2023
  
  f701ba7d
- very rough way of utilzing verbosity · ca8b00cc
  lintangsutawika authored Nov 02, 2023
  
  ca8b00cc
- Rename greedy_until_template_yaml to generate_until_template_yaml · 0d1fb8a5
  Lintang Sutawika authored Nov 02, 2023
  
  0d1fb8a5
- added group and task alias · 6dfe848e
  lintangsutawika authored Nov 02, 2023
  
  6dfe848e
01 Nov, 2023 2 commits
- replace with no_train mmlu dataset · f5cf38a9
  haileyschoelkopf authored Nov 01, 2023
  
  f5cf38a9
- rename template for generate_until bb tasks · a922db88
  haileyschoelkopf authored Nov 01, 2023
  
  a922db88
19 Oct, 2023 3 commits
- fixes to pythia benchmark, boolqseq2seq · 1428ad57
  haileyschoelkopf authored Oct 19, 2023
  
  1428ad57
- fix issue with default metrics and aggregation functions · 90d818da
  lintangsutawika authored Oct 19, 2023
  
  90d818da
- fix two bugs when ran with qasper_bool and toxigen · a007bacb
  Zhiwei Zhuang authored Oct 19, 2023
  
  a007bacb
17 Oct, 2023 2 commits
- changed file name · a7ba3d76
  lintangsutawika authored Oct 17, 2023
  
  a7ba3d76
- change all mentions of `greedy_until` to `generate_until` · c64bf9a9
  lintangsutawika authored Oct 17, 2023
  
  c64bf9a9