Commits · 835cc40e414ea9e234e6dd3b16b9885cd2142ed3 · gaoqiong / lm-evaluation-harness

04 Dec, 2023 2 commits
- add \n\n to end of description · c30b71c3
  lintangsutawika authored Dec 04, 2023
  
  c30b71c3
- add \n\n to end of description · b32b3793
  lintangsutawika authored Dec 04, 2023
  
  b32b3793
28 Nov, 2023 11 commits
- Delete lm_eval/tasks/siqa/bigbench.yaml · 331d7c51
  Stella Biderman authored Nov 28, 2023
  
  331d7c51
- Update default.yml · 20463a3f
  Stella Biderman authored Nov 28, 2023
  
  20463a3f
- Rename bigbench.yml to default.yml · 5dcbcd63
  Stella Biderman authored Nov 28, 2023
```
Changing the name since this is not actually the big bench format.
```
  5dcbcd63
- reformat · 5ded4d5b
  lintangsutawika authored Nov 28, 2023
  
  5ded4d5b
- reformat · 37a46351
  lintangsutawika authored Nov 28, 2023
  
  37a46351
- update version · 43f615c9
  lintangsutawika authored Nov 28, 2023
  
  43f615c9
- update version · 94cdface
  lintangsutawika authored Nov 28, 2023
  
  94cdface
- add versions · 0d03a9f3
  lintangsutawika authored Nov 28, 2023
  
  0d03a9f3
- renamed template file to make it easier to search · 19738ed2
  lintangsutawika authored Nov 28, 2023
  
  19738ed2
- renamed template file to make it easier to search · db8928b0
  lintangsutawika authored Nov 28, 2023
  
  db8928b0
- removed flan from the naming · 3b9640b8
  lintangsutawika authored Nov 28, 2023
  
  3b9640b8
27 Nov, 2023 6 commits
- Update README.md · 5535fbd4
  Stella Biderman authored Nov 27, 2023
  
  5535fbd4
- Update README.md · 4706fbb2
  Stella Biderman authored Nov 27, 2023
  
  4706fbb2
- Create bigbench.yml · 11129906
  Stella Biderman authored Nov 27, 2023
  
  11129906
- Create README.md · babdc8d6
  Stella Biderman authored Nov 27, 2023
  
  babdc8d6
- 'flan' in groupnames optional for all variants · 1e5ca7a4
  haileyschoelkopf authored Nov 27, 2023
  
  1e5ca7a4
- make 'bbh' a group name for flan cot 3-shot, add stopseqs · e408c2ce
  haileyschoelkopf authored Nov 27, 2023
  
  e408c2ce
17 Nov, 2023 5 commits
- update bigbench datasets to mirror, rename groupnames · 487767ab
  haileyschoelkopf authored Nov 17, 2023
  
  487767ab
- precommit · f40b7d0e
  lintangsutawika authored Nov 17, 2023
  
  f40b7d0e
- edits and format · 10cc0a56
  lintangsutawika authored Nov 17, 2023
  
  10cc0a56
- added alternative prompts for mathqa · bbd6ab3a
  lintangsutawika authored Nov 17, 2023
  
  bbd6ab3a
- added alternative prompts for hellaswag · 7cd1555e
  lintangsutawika authored Nov 17, 2023
  
  7cd1555e
15 Nov, 2023 1 commit
- update squad file · c9a3fd3f
  lintangsutawika authored Nov 15, 2023
  
  c9a3fd3f
14 Nov, 2023 2 commits
- add task_alias · f8740ff4
  lintangsutawika authored Nov 14, 2023
  
  f8740ff4
- alternative prompts for arithmetic · c25f6a31
  lintangsutawika authored Nov 14, 2023
  
  c25f6a31
10 Nov, 2023 2 commits
- fixes · 69186ef2
  lintangsutawika authored Nov 10, 2023
  
  69186ef2
- added initialize_task and updated where eval_logger is imported from · 056c9d85
  lintangsutawika authored Nov 10, 2023
  
  056c9d85
09 Nov, 2023 7 commits
- updates to scrolls · 51753750
  lintangsutawika authored Nov 09, 2023
  
  51753750
- reformat · 097c9253
  lintangsutawika authored Nov 09, 2023
  
  097c9253
- reformat · 6c812bb5
  lintangsutawika authored Nov 09, 2023
  
  6c812bb5
- reformat · 9a64e642
  lintangsutawika authored Nov 09, 2023
  
  9a64e642
- add scrolls · 75137836
  lintangsutawika authored Nov 09, 2023
  
  75137836
- readded task descriptions · a3520619
  lintangsutawika authored Nov 09, 2023
  
  a3520619
- merged cont-metrics here · 6998762a
  lintangsutawika authored Nov 09, 2023
  
  6998762a
08 Nov, 2023 4 commits
- Update generate_until_template_yaml · 1522009c
  Lintang Sutawika authored Nov 08, 2023
  
  1522009c
- removed yaml version of squad · d3f429ac
  lintangsutawika authored Nov 08, 2023
  
  d3f429ac
- removed yaml version of squad · 9817e7c2
  lintangsutawika authored Nov 08, 2023
  
  9817e7c2
- added comment line · 7b60ead4
  lintangsutawika authored Nov 08, 2023
  
  7b60ead4