Commits · d2804132e2d73855ca139b3ade44bc7819664c19 · gaoqiong / lm-evaluation-harness

13 Sep, 2023 5 commits
- aggregates across tasks within the same group in addition to average accross task average · d2804132
  lintangsutawika authored Sep 13, 2023
  
  d2804132
- better presentation · d4f62844
  lintangsutawika authored Sep 13, 2023
  
  d4f62844
- cleaner process · e1e05b19
  lintangsutawika authored Sep 13, 2023
  
  e1e05b19
- cleaner process · 91d84840
  lintangsutawika authored Sep 13, 2023
  
  91d84840
- fixed warning · 6414d55b
  lintangsutawika authored Sep 13, 2023
  
  6414d55b
12 Sep, 2023 9 commits
- remove comments · 993baaa6
  lintangsutawika authored Sep 12, 2023
  
  993baaa6
- add TODO · 973d563a
  lintangsutawika authored Sep 12, 2023
  
  973d563a
- add TODO · b11f7f37
  lintangsutawika authored Sep 12, 2023
  
  b11f7f37
- update · d29c0940
  lintangsutawika authored Sep 12, 2023
  
  d29c0940
- update · 17ec4906
  lintangsutawika authored Sep 12, 2023
  
  17ec4906
- presented with task-group relation · aed4e694
  lintangsutawika authored Sep 12, 2023
  
  aed4e694
- changed term to groups · 6bba33db
  lintangsutawika authored Sep 12, 2023
  
  6bba33db
- changed term to groups · 4e4f0de2
  lintangsutawika authored Sep 12, 2023
  
  4e4f0de2
- allow nested groups · f7d98500
  lintangsutawika authored Sep 12, 2023
  
  f7d98500
06 Sep, 2023 11 commits
- Merge pull request #784 from EleutherAI/mgsm · 3839125a
  Lintang Sutawika authored Sep 06, 2023
```
[Refactor] mgsm
```
  3839125a
- edit readme · 78522c94
  lintangsutawika authored Sep 06, 2023
  
  78522c94
- change name · 681b2e2c
  lintangsutawika authored Sep 06, 2023
  
  681b2e2c
- tidy up · fd279089
  lintangsutawika authored Sep 06, 2023
  
  fd279089
- Merge pull request #838 from EleutherAI/lintangsutawika-patch-2 · 784fe037
  Hailey Schoelkopf authored Sep 06, 2023
```
Update README.md
```
  784fe037
- Update README.md · 00c4ffff
  Lintang Sutawika authored Sep 06, 2023
```
Crossed WMT off.
```
  00c4ffff
- Merge pull request #831 from baberabb/big-refactor_python_final · e9d46380
  Hailey Schoelkopf authored Sep 06, 2023
```
[Refactor] consolidated tasks tests
```
  e9d46380
- changed atol · dfc47bd5
  baberabb authored Sep 06, 2023
  
  dfc47bd5
- Merge remote-tracking branch 'origin/big-refactor' into big-refactor_python_final · e0311cd5
  baberabb authored Sep 06, 2023
  
  e0311cd5
- artifact loglikelihood results · 96c60cf6
  baberabb authored Sep 06, 2023
  
  96c60cf6
- added torch deterministic · f1e62d36
  baberabb authored Sep 05, 2023
  
  f1e62d36
05 Sep, 2023 10 commits
- Merge pull request #775 from EleutherAI/wmt · f86d6874
  Lintang Sutawika authored Sep 05, 2023
```
[Refactor] Add WMT tasks
```
  f86d6874
- format for pre-commit · 01ad787d
  lintangsutawika authored Sep 05, 2023
  
  01ad787d
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into wmt · c417292d
  lintangsutawika authored Sep 05, 2023
  
  c417292d
- Merge pull request #833 from EleutherAI/fix-ppl · 1a02d9df
  Hailey Schoelkopf authored Sep 05, 2023
```
[Refactor] Fix wikitext task
```
  1a02d9df
- pre-commit · 9bca36a9
  lintangsutawika authored Sep 05, 2023
  
  9bca36a9
- change words/bytes calc for wikitext · a7286607
  haileyschoelkopf authored Sep 05, 2023
  
  a7286607
- Merge branch 'big-refactor' into wmt · 3b4fa26e
  Lintang Sutawika authored Sep 05, 2023
  
  3b4fa26e
- Merge pull request #809 from ethanhs/mypy · 8f448eed
  Hailey Schoelkopf authored Sep 05, 2023
```
Add mypy baseline config
```
  8f448eed
- Merge branch 'big-refactor' into mypy · 4721379e
  Hailey Schoelkopf authored Sep 05, 2023
  
  4721379e
- consolidated tasks testing · 6cc1ae7c
  baberabb authored Sep 05, 2023
  
  6cc1ae7c
04 Sep, 2023 2 commits
- Merge pull request #812 from fattorib/bump-accelerate · cc7828dd
  Hailey Schoelkopf authored Sep 04, 2023
```
[Refactor] Bump min accelerate version and update documentation
```
  cc7828dd
- placate precommit · f96f330f
  Hailey Schoelkopf authored Sep 04, 2023
  
  f96f330f
03 Sep, 2023 1 commit
- Merge remote-tracking branch 'origin/big-refactor' into big-refactor_python · 2e747c5b
  baberabb authored Sep 03, 2023
  
  2e747c5b
31 Aug, 2023 2 commits
- modifed error message · d01cc479
  lintangsutawika authored Aug 31, 2023
  
  d01cc479
- modifed error message · 3c842795
  lintangsutawika authored Aug 31, 2023
  
  3c842795