Commits · db79d92743784911f18829aae9adaeab186d222d · gaoqiong / lm-evaluation-harness

"examples/trials/mnist/config_pai.yml" did not exist on "5c042627a12815e07d75d714ea5e142e0cea3dc5"

29 Aug, 2023 4 commits
- added subtasks · db79d927
  lintangsutawika authored Aug 29, 2023
  
  db79d927
- udpated to work · 4bdf11e1
  lintangsutawika authored Aug 29, 2023
  
  4bdf11e1
- expanded benchmark to allow new source of prompt templates · d1c3cb3d
  lintangsutawika authored Aug 29, 2023
  
  d1c3cb3d
- Merge pull request #769 from EleutherAI/superglue · 21e1ed17
  Lintang Sutawika authored Aug 29, 2023
```
[Refactor] Superglue T5 Parity
```
  21e1ed17
26 Aug, 2023 1 commit
- Merge pull request #744 from EleutherAI/update_docs · 4cda3a1c
  Lintang Sutawika authored Aug 26, 2023
  
  4cda3a1c
25 Aug, 2023 7 commits
- Update new_task_guide.md · 3add967a
  Lintang Sutawika authored Aug 25, 2023
  
  3add967a
- removed unused line · b7082722
  lintangsutawika authored Aug 25, 2023
  
  b7082722
- add benchmark with t5x · 5aec6f26
  lintangsutawika authored Aug 25, 2023
  
  5aec6f26
- added info · 1d77a7b8
  lintangsutawika authored Aug 25, 2023
  
  1d77a7b8
- reformat · ec4bc493
  lintangsutawika authored Aug 25, 2023
  
  ec4bc493
- fixed group to int · a3eb6393
  lintangsutawika authored Aug 25, 2023
  
  a3eb6393
- reformat · caac0843
  lintangsutawika authored Aug 25, 2023
  
  caac0843
24 Aug, 2023 5 commits
- adding record processing · adbbfb44
  lintangsutawika authored Aug 24, 2023
  
  adbbfb44
- edit to accept docs · 599205c4
  lintangsutawika authored Aug 24, 2023
  
  599205c4
- add wsc utils · faa2e43d
  lintangsutawika authored Aug 24, 2023
  
  faa2e43d
- modified apply method to accept docs · 007d485b
  lintangsutawika authored Aug 24, 2023
  
  007d485b
- filter takes docs as argument in case filtering requires it · cb485883
  lintangsutawika authored Aug 24, 2023
  
  cb485883
23 Aug, 2023 12 commits
- merged updated big-refactor · 7d16a7cd
  lintangsutawika authored Aug 23, 2023
  
  7d16a7cd
- Merge pull request #802 from EleutherAI/fix-metrics · a005aeba
  Lintang Sutawika authored Aug 24, 2023
```
Merge Fix metrics branch
```
  a005aeba
- minor fix · f5d0f8e6
  lintangsutawika authored Aug 23, 2023
  
  f5d0f8e6
- readded missing chunk · 4fe3409e
  lintangsutawika authored Aug 23, 2023
  
  4fe3409e
- Merge pull request #803 from Wehzie/big-refactor · c01d5bac
  Lintang Sutawika authored Aug 24, 2023
```
Update README.md
```
  c01d5bac
- Merge branch 'fix-metrics' of https://github.com/EleutherAI/lm-evaluation-harness into fix-metrics · f3a82004
  lintangsutawika authored Aug 23, 2023
  
  f3a82004
- fix condition where a benchmark and a regular task is called together · 2f0ef6ca
  lintangsutawika authored Aug 23, 2023
  
  2f0ef6ca
- Update README.md · 91d3f6c4
  Rafael Tappe Maestro authored Aug 23, 2023
```
fix broken link
```
  91d3f6c4
- Merge branch 'big-refactor' into fix-metrics · 45cc68ee
  USVSN SAI PRASHANTH authored Aug 23, 2023
  
  45cc68ee
- temp · 691b4ca9
  lintangsutawika authored Aug 23, 2023
  
  691b4ca9
- fix for choices · 32294ff1
  lintangsutawika authored Aug 23, 2023
  
  32294ff1
- temp · 18f7dfb3
  lintangsutawika authored Aug 23, 2023
  
  18f7dfb3
22 Aug, 2023 11 commits
- add multirc metrics · 8c93320a
  lintangsutawika authored Aug 22, 2023
  
  8c93320a
- add cb metrics · 4a768feb
  lintangsutawika authored Aug 22, 2023
  
  4a768feb
- fix test_choice test · 80d88899
  lintangsutawika authored Aug 22, 2023
  
  80d88899
- update yaml · f7a0235d
  lintangsutawika authored Aug 22, 2023
  
  f7a0235d
- added truncation option · d4e075e3
  lintangsutawika authored Aug 22, 2023
  
  d4e075e3
- add endspace · f96f5fad
  lintangsutawika authored Aug 22, 2023
  
  f96f5fad
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into superglue · bf4eb3e8
  lintangsutawika authored Aug 22, 2023
  
  bf4eb3e8
- add endspace · cc6662e1
  lintangsutawika authored Aug 22, 2023
  
  cc6662e1
- Merge pull request #780 from EleutherAI/fix-metrics · b5b01a49
  Lintang Sutawika authored Aug 22, 2023
```
[Refactor] Fix metrics in Greedy Until
```
  b5b01a49
- add to ignore.txt · 48e32540
  lintangsutawika authored Aug 22, 2023
  
  48e32540
- fix bleu · e3c70cad
  lintangsutawika authored Aug 22, 2023
  
  e3c70cad