Commits · e2ed49f81feba446d4f56eb568b494767f803b83 · gaoqiong / lm-evaluation-harness

18 Sep, 2023 2 commits
- format · 11be7c93
  lintangsutawika authored Sep 18, 2023
  
  11be7c93
- remove scrolls from this PR · d1c189ea
  lintangsutawika authored Sep 18, 2023
  
  d1c189ea
15 Sep, 2023 1 commit
- allow for trailing comma in model_args · 4ff8260d
  haileyschoelkopf authored Sep 15, 2023
  
  4ff8260d
14 Sep, 2023 8 commits
- refactored hendrycks_math to minerva_math · a554e41b
  baberabb authored Sep 15, 2023
  
  a554e41b
- list(gold) if `multiple_target` · 5f205bd5
  baberabb authored Sep 15, 2023
  
  5f205bd5
- add hendryck_math tasks; bugfixes · 1a34d084
  baberabb authored Sep 14, 2023
  
  1a34d084
- fix typo · b1dd5853
  haileyschoelkopf authored Sep 14, 2023
  
  b1dd5853
- remove omegaconf usage · 98747638
  haileyschoelkopf authored Sep 14, 2023
  
  98747638
- Use Dict to make the code python 3.8 compatible · 38c9689a
  Chris authored Sep 14, 2023
  
  38c9689a
- change prompt formatting · 680c5686
  baberabb authored Sep 14, 2023
  
  680c5686
- Refactor whitespace check and add handling for multiple_targets · bf038375
  baberabb authored Sep 14, 2023
  
  bf038375
13 Sep, 2023 8 commits
- Update device list and dtype detection for MPS · bd81b8c0
  baberabb authored Sep 14, 2023
  
  bd81b8c0
- add qasper in scrolls · 020abc86
  lintangsutawika authored Sep 13, 2023
  
  020abc86
- add comments · 892f40a9
  lintangsutawika authored Sep 13, 2023
  
  892f40a9
- aggregates across tasks within the same group in addition to average accross task average · d2804132
  lintangsutawika authored Sep 13, 2023
  
  d2804132
- better presentation · d4f62844
  lintangsutawika authored Sep 13, 2023
  
  d4f62844
- cleaner process · e1e05b19
  lintangsutawika authored Sep 13, 2023
  
  e1e05b19
- cleaner process · 91d84840
  lintangsutawika authored Sep 13, 2023
  
  91d84840
- fixed warning · 6414d55b
  lintangsutawika authored Sep 13, 2023
  
  6414d55b
12 Sep, 2023 10 commits
- remove comments · 993baaa6
  lintangsutawika authored Sep 12, 2023
  
  993baaa6
- add TODO · 973d563a
  lintangsutawika authored Sep 12, 2023
  
  973d563a
- add TODO · b11f7f37
  lintangsutawika authored Sep 12, 2023
  
  b11f7f37
- update · d29c0940
  lintangsutawika authored Sep 12, 2023
  
  d29c0940
- update · 17ec4906
  lintangsutawika authored Sep 12, 2023
  
  17ec4906
- presented with task-group relation · aed4e694
  lintangsutawika authored Sep 12, 2023
  
  aed4e694
- changed term to groups · 6bba33db
  lintangsutawika authored Sep 12, 2023
  
  6bba33db
- changed term to groups · 4e4f0de2
  lintangsutawika authored Sep 12, 2023
  
  4e4f0de2
- allow nested groups · f7d98500
  lintangsutawika authored Sep 12, 2023
  
  f7d98500
- fix typo · 5ebe28eb
  lintangsutawika authored Sep 12, 2023
  
  5ebe28eb
11 Sep, 2023 4 commits
- make Task._config a public property · fb436108
  haileyschoelkopf authored Sep 11, 2023
  
  fb436108
- update evaluator docstring · 0b99c7d2
  haileyschoelkopf authored Sep 11, 2023
  
  0b99c7d2
- english cot, and added readable text in utils.py · e6939479
  lintangsutawika authored Sep 11, 2023
  
  e6939479
- update · c87703f3
  lintangsutawika authored Sep 11, 2023
  
  c87703f3
07 Sep, 2023 7 commits
- add scrolls · d1f50270
  lintangsutawika authored Sep 07, 2023
  
  d1f50270
- normalize path · 4b711aa6
  lintangsutawika authored Sep 07, 2023
  
  4b711aa6
- fixed import · d3d1b7f1
  lintangsutawika authored Sep 07, 2023
  
  d3d1b7f1
- checked mutual and qasper · e0e0746d
  lintangsutawika authored Sep 07, 2023
  
  e0e0746d
- update · 46bd5e46
  lintangsutawika authored Sep 07, 2023
  
  46bd5e46
- add qasper · 2d530664
  lintangsutawika authored Sep 07, 2023
  
  2d530664
- add mutual · af4b012e
  lintangsutawika authored Sep 07, 2023
  
  af4b012e