Commits · a07d05f7ca188199cf5e6e5e827beb2e3780fa4c · gaoqiong / lm-evaluation-harness

13 Sep, 2023 7 commits
- Update device list and dtype detection for MPS · bd81b8c0
  baberabb authored Sep 14, 2023
  
  bd81b8c0
- add comments · 892f40a9
  lintangsutawika authored Sep 13, 2023
  
  892f40a9
- aggregates across tasks within the same group in addition to average accross task average · d2804132
  lintangsutawika authored Sep 13, 2023
  
  d2804132
- better presentation · d4f62844
  lintangsutawika authored Sep 13, 2023
  
  d4f62844
- cleaner process · e1e05b19
  lintangsutawika authored Sep 13, 2023
  
  e1e05b19
- cleaner process · 91d84840
  lintangsutawika authored Sep 13, 2023
  
  91d84840
- fixed warning · 6414d55b
  lintangsutawika authored Sep 13, 2023
  
  6414d55b
12 Sep, 2023 10 commits
- remove comments · 993baaa6
  lintangsutawika authored Sep 12, 2023
  
  993baaa6
- add TODO · 973d563a
  lintangsutawika authored Sep 12, 2023
  
  973d563a
- add TODO · b11f7f37
  lintangsutawika authored Sep 12, 2023
  
  b11f7f37
- update · d29c0940
  lintangsutawika authored Sep 12, 2023
  
  d29c0940
- update · 17ec4906
  lintangsutawika authored Sep 12, 2023
  
  17ec4906
- presented with task-group relation · aed4e694
  lintangsutawika authored Sep 12, 2023
  
  aed4e694
- changed term to groups · 6bba33db
  lintangsutawika authored Sep 12, 2023
  
  6bba33db
- changed term to groups · 4e4f0de2
  lintangsutawika authored Sep 12, 2023
  
  4e4f0de2
- allow nested groups · f7d98500
  lintangsutawika authored Sep 12, 2023
  
  f7d98500
- fix typo · 5ebe28eb
  lintangsutawika authored Sep 12, 2023
  
  5ebe28eb
11 Sep, 2023 3 commits
- make Task._config a public property · fb436108
  haileyschoelkopf authored Sep 11, 2023
  
  fb436108
- update evaluator docstring · 0b99c7d2
  haileyschoelkopf authored Sep 11, 2023
  
  0b99c7d2
- english cot, and added readable text in utils.py · e6939479
  lintangsutawika authored Sep 11, 2023
  
  e6939479
06 Sep, 2023 4 commits
- edit readme · 78522c94
  lintangsutawika authored Sep 06, 2023
  
  78522c94
- change name · 681b2e2c
  lintangsutawika authored Sep 06, 2023
  
  681b2e2c
- tidy up · fd279089
  lintangsutawika authored Sep 06, 2023
  
  fd279089
- Update README.md · 00c4ffff
  Lintang Sutawika authored Sep 06, 2023
```
Crossed WMT off.
```
  00c4ffff
05 Sep, 2023 3 commits
- format for pre-commit · 01ad787d
  lintangsutawika authored Sep 05, 2023
  
  01ad787d
- pre-commit · 9bca36a9
  lintangsutawika authored Sep 05, 2023
  
  9bca36a9
- change words/bytes calc for wikitext · a7286607
  haileyschoelkopf authored Sep 05, 2023
  
  a7286607
04 Sep, 2023 2 commits
- placate precommit · f96f330f
  Hailey Schoelkopf authored Sep 04, 2023
  
  f96f330f
- add top-level import · fdb601a5
  haileyschoelkopf authored Sep 04, 2023
  
  fdb601a5
30 Aug, 2023 11 commits
- moved API inside function; API expects json · 788b6f94
  baberabb authored Aug 30, 2023
  
  788b6f94
- formatting · ee59182d
  lintangsutawika authored Aug 30, 2023
  
  ee59182d
- add logging information · c605a710
  lintangsutawika authored Aug 30, 2023
  
  c605a710
- Update task.py · ebfff08f
  Lintang Sutawika authored Aug 30, 2023
  
  ebfff08f
- Update task.py · 8d1d003d
  Lintang Sutawika authored Aug 30, 2023
  
  8d1d003d
- checked coqa on readme · 8287fe7c
  lintangsutawika authored Aug 30, 2023
  
  8287fe7c
- fix formatting · f555a583
  lintangsutawika authored Aug 30, 2023
  
  f555a583
- running process for drop · 79aa53b1
  lintangsutawika authored Aug 30, 2023
  
  79aa53b1
- add coqa · 64d4600c
  lintangsutawika authored Aug 30, 2023
  
  64d4600c
- add drop · f9558ce5
  lintangsutawika authored Aug 30, 2023
  
  f9558ce5
- reformat · cddbf9f6
  lintangsutawika authored Aug 30, 2023
  
  cddbf9f6