Commits · 1f3510673ce7c51a2ef1caed8edcfa8ccb00abd4 · gaoqiong / lm-evaluation-harness

15 Sep, 2023 1 commit
- allow for trailing comma in model_args · 4ff8260d
  haileyschoelkopf authored Sep 15, 2023
  
  4ff8260d
14 Sep, 2023 6 commits
- list(gold) if `multiple_target` · 5f205bd5
  baberabb authored Sep 15, 2023
  
  5f205bd5
- fix typo · b1dd5853
  haileyschoelkopf authored Sep 14, 2023
  
  b1dd5853
- remove omegaconf usage · 98747638
  haileyschoelkopf authored Sep 14, 2023
  
  98747638
- Use Dict to make the code python 3.8 compatible · 38c9689a
  Chris authored Sep 14, 2023
  
  38c9689a
- change prompt formatting · 680c5686
  baberabb authored Sep 14, 2023
  
  680c5686
- Refactor whitespace check and add handling for multiple_targets · bf038375
  baberabb authored Sep 14, 2023
  
  bf038375
13 Sep, 2023 8 commits
- Update device list and dtype detection for MPS · bd81b8c0
  baberabb authored Sep 14, 2023
  
  bd81b8c0
- add qasper in scrolls · 020abc86
  lintangsutawika authored Sep 13, 2023
  
  020abc86
- add comments · 892f40a9
  lintangsutawika authored Sep 13, 2023
  
  892f40a9
- aggregates across tasks within the same group in addition to average accross task average · d2804132
  lintangsutawika authored Sep 13, 2023
  
  d2804132
- better presentation · d4f62844
  lintangsutawika authored Sep 13, 2023
  
  d4f62844
- cleaner process · e1e05b19
  lintangsutawika authored Sep 13, 2023
  
  e1e05b19
- cleaner process · 91d84840
  lintangsutawika authored Sep 13, 2023
  
  91d84840
- fixed warning · 6414d55b
  lintangsutawika authored Sep 13, 2023
  
  6414d55b
12 Sep, 2023 10 commits
- remove comments · 993baaa6
  lintangsutawika authored Sep 12, 2023
  
  993baaa6
- add TODO · 973d563a
  lintangsutawika authored Sep 12, 2023
  
  973d563a
- add TODO · b11f7f37
  lintangsutawika authored Sep 12, 2023
  
  b11f7f37
- update · d29c0940
  lintangsutawika authored Sep 12, 2023
  
  d29c0940
- update · 17ec4906
  lintangsutawika authored Sep 12, 2023
  
  17ec4906
- presented with task-group relation · aed4e694
  lintangsutawika authored Sep 12, 2023
  
  aed4e694
- changed term to groups · 6bba33db
  lintangsutawika authored Sep 12, 2023
  
  6bba33db
- changed term to groups · 4e4f0de2
  lintangsutawika authored Sep 12, 2023
  
  4e4f0de2
- allow nested groups · f7d98500
  lintangsutawika authored Sep 12, 2023
  
  f7d98500
- fix typo · 5ebe28eb
  lintangsutawika authored Sep 12, 2023
  
  5ebe28eb
11 Sep, 2023 4 commits
- make Task._config a public property · fb436108
  haileyschoelkopf authored Sep 11, 2023
  
  fb436108
- update evaluator docstring · 0b99c7d2
  haileyschoelkopf authored Sep 11, 2023
  
  0b99c7d2
- english cot, and added readable text in utils.py · e6939479
  lintangsutawika authored Sep 11, 2023
  
  e6939479
- update · c87703f3
  lintangsutawika authored Sep 11, 2023
  
  c87703f3
07 Sep, 2023 8 commits
- add scrolls · d1f50270
  lintangsutawika authored Sep 07, 2023
  
  d1f50270
- normalize path · 4b711aa6
  lintangsutawika authored Sep 07, 2023
  
  4b711aa6
- fixed import · d3d1b7f1
  lintangsutawika authored Sep 07, 2023
  
  d3d1b7f1
- checked mutual and qasper · e0e0746d
  lintangsutawika authored Sep 07, 2023
  
  e0e0746d
- update · 46bd5e46
  lintangsutawika authored Sep 07, 2023
  
  46bd5e46
- add qasper · 2d530664
  lintangsutawika authored Sep 07, 2023
  
  2d530664
- add mutual · af4b012e
  lintangsutawika authored Sep 07, 2023
  
  af4b012e
- adjust · 57c29709
  lintangsutawika authored Sep 07, 2023
  
  57c29709
06 Sep, 2023 3 commits
- edit readme · 78522c94
  lintangsutawika authored Sep 06, 2023
  
  78522c94
- change name · 681b2e2c
  lintangsutawika authored Sep 06, 2023
  
  681b2e2c
- tidy up · fd279089
  lintangsutawika authored Sep 06, 2023
  
  fd279089