Commits · b7a4ea062159ea4b8e4e41cbe633e730b1925ce5 · gaoqiong / lm-evaluation-harness

03 Nov, 2023 3 commits
- fix gsm8k regexes · 93d088c8
  haileyschoelkopf authored Nov 03, 2023
  
  93d088c8
- Update _generate_configs.py · 4d9b928e
  Hailey Schoelkopf authored Nov 03, 2023
  
  4d9b928e
- remove gold_alias from codebase · 37ac5f46
  haileyschoelkopf authored Nov 03, 2023
  
  37ac5f46
02 Nov, 2023 2 commits
- Rename greedy_until_template_yaml to generate_until_template_yaml · 0d1fb8a5
  Lintang Sutawika authored Nov 02, 2023
  
  0d1fb8a5
- added group and task alias · 6dfe848e
  lintangsutawika authored Nov 02, 2023
  
  6dfe848e
01 Nov, 2023 2 commits
- replace with no_train mmlu dataset · f5cf38a9
  haileyschoelkopf authored Nov 01, 2023
  
  f5cf38a9
- rename template for generate_until bb tasks · a922db88
  haileyschoelkopf authored Nov 01, 2023
  
  a922db88
19 Oct, 2023 3 commits
- fixes to pythia benchmark, boolqseq2seq · 1428ad57
  haileyschoelkopf authored Oct 19, 2023
  
  1428ad57
- fix issue with default metrics and aggregation functions · 90d818da
  lintangsutawika authored Oct 19, 2023
  
  90d818da
- fix two bugs when ran with qasper_bool and toxigen · a007bacb
  Zhiwei Zhuang authored Oct 19, 2023
  
  a007bacb
17 Oct, 2023 6 commits
- changed file name · a7ba3d76
  lintangsutawika authored Oct 17, 2023
  
  a7ba3d76
- change all mentions of `greedy_until` to `generate_until` · c64bf9a9
  lintangsutawika authored Oct 17, 2023
  
  c64bf9a9
- added subgroups for other mmlu variants · 109ed1c7
  lintangsutawika authored Oct 17, 2023
  
  109ed1c7
- precommit stuff · a2c4139b
  lintangsutawika authored Oct 17, 2023
  
  a2c4139b
- pre-commit reformat · c4f0bf75
  lintangsutawika authored Oct 17, 2023
  
  c4f0bf75
- template yaml · 2ade9693
  lintangsutawika authored Oct 17, 2023
  
  2ade9693
16 Oct, 2023 3 commits
- update · 11fdcb49
  lintangsutawika authored Oct 16, 2023
  
  11fdcb49
- added stderr reprocessing for groups · 00859825
  lintangsutawika authored Oct 16, 2023
  
  00859825
- modfied to add subcategory · 92f25463
  lintangsutawika authored Oct 16, 2023
  
  92f25463
12 Oct, 2023 1 commit
- Update __init__.py · 32a6362c
  Lintang Sutawika authored Oct 12, 2023
  
  32a6362c
10 Oct, 2023 4 commits
- fixes and adjustments · 0d701496
  lintangsutawika authored Oct 10, 2023
  
  0d701496
- error set to DEBUG · e33a7d92
  lintangsutawika authored Oct 10, 2023
  
  e33a7d92
- add verbose arg · 9894597c
  lintangsutawika authored Oct 10, 2023
  
  9894597c
- removed delimiter="" · bc1b0eca
  lintangsutawika authored Oct 10, 2023
  
  bc1b0eca
08 Oct, 2023 1 commit
- Improve error logging · 4d8094bb
  baberabb authored Oct 09, 2023
  
  4d8094bb
06 Oct, 2023 2 commits
- adjustments · 7d5e511c
  lintangsutawika authored Oct 06, 2023
  
  7d5e511c
- changed default to 5-shot · 2493c6cc
  lintangsutawika authored Oct 06, 2023
  
  2493c6cc
05 Oct, 2023 3 commits
- pre-commit reformat · f2c396ab
  lintangsutawika authored Oct 05, 2023
  
  f2c396ab
- removed print messages, added cot extraction strings · 20a54b3a
  lintangsutawika authored Oct 05, 2023
  
  20a54b3a
- change : to . in the prompt · 24ecd386
  ManuelFay authored Oct 05, 2023
  
  24ecd386
04 Oct, 2023 3 commits
- change back to original dataset path · 51a43a76
  haileyschoelkopf authored Oct 04, 2023
  
  51a43a76
- change back to original dataset path · 54498fcc
  haileyschoelkopf authored Oct 04, 2023
  
  54498fcc
- modify default yamls · 7e6e3c20
  haileyschoelkopf authored Oct 04, 2023
  
  7e6e3c20
03 Oct, 2023 5 commits
- add bigbench push_to_hub script · 67c0f73a
  haileyschoelkopf authored Oct 03, 2023
  
  67c0f73a
- add bigbench push_to_hub script · fa608798
  haileyschoelkopf authored Oct 03, 2023
  
  fa608798
- push updated bigbench task yamls · 8806944e
  haileyschoelkopf authored Oct 03, 2023
  
  8806944e
- update generate_tasks.py and template yamls · 1a77b4d5
  haileyschoelkopf authored Oct 03, 2023
  
  1a77b4d5
- Bring task name to `pubmedqa` in line with master branch · 3a7f52d0
  Hailey Schoelkopf authored Oct 03, 2023
  
  3a7f52d0
02 Oct, 2023 2 commits
- Fix formatting · 06ce7a62
  Chris authored Oct 02, 2023
  
  06ce7a62
- Add PolEmo2 tasks · e634f83f
  Chris authored Oct 02, 2023
  
  e634f83f