Commits · f9558ce5ddea0dee5ad0e6e8fc5bc5676765aed3 · gaoqiong / lm-evaluation-harness

30 Aug, 2023 1 commit
- add drop · f9558ce5
  lintangsutawika authored Aug 30, 2023
  
  f9558ce5
29 Aug, 2023 1 commit
- Merge pull request #769 from EleutherAI/superglue · 21e1ed17
  Lintang Sutawika authored Aug 29, 2023
```
[Refactor] Superglue T5 Parity
```
  21e1ed17
26 Aug, 2023 1 commit
- Merge pull request #744 from EleutherAI/update_docs · 4cda3a1c
  Lintang Sutawika authored Aug 26, 2023
  
  4cda3a1c
25 Aug, 2023 7 commits
- Update new_task_guide.md · 3add967a
  Lintang Sutawika authored Aug 25, 2023
  
  3add967a
- removed unused line · b7082722
  lintangsutawika authored Aug 25, 2023
  
  b7082722
- add benchmark with t5x · 5aec6f26
  lintangsutawika authored Aug 25, 2023
  
  5aec6f26
- added info · 1d77a7b8
  lintangsutawika authored Aug 25, 2023
  
  1d77a7b8
- reformat · ec4bc493
  lintangsutawika authored Aug 25, 2023
  
  ec4bc493
- fixed group to int · a3eb6393
  lintangsutawika authored Aug 25, 2023
  
  a3eb6393
- reformat · caac0843
  lintangsutawika authored Aug 25, 2023
  
  caac0843
24 Aug, 2023 5 commits
- adding record processing · adbbfb44
  lintangsutawika authored Aug 24, 2023
  
  adbbfb44
- edit to accept docs · 599205c4
  lintangsutawika authored Aug 24, 2023
  
  599205c4
- add wsc utils · faa2e43d
  lintangsutawika authored Aug 24, 2023
  
  faa2e43d
- modified apply method to accept docs · 007d485b
  lintangsutawika authored Aug 24, 2023
  
  007d485b
- filter takes docs as argument in case filtering requires it · cb485883
  lintangsutawika authored Aug 24, 2023
  
  cb485883
23 Aug, 2023 12 commits
- merged updated big-refactor · 7d16a7cd
  lintangsutawika authored Aug 23, 2023
  
  7d16a7cd
- Merge pull request #802 from EleutherAI/fix-metrics · a005aeba
  Lintang Sutawika authored Aug 24, 2023
```
Merge Fix metrics branch
```
  a005aeba
- minor fix · f5d0f8e6
  lintangsutawika authored Aug 23, 2023
  
  f5d0f8e6
- readded missing chunk · 4fe3409e
  lintangsutawika authored Aug 23, 2023
  
  4fe3409e
- Merge pull request #803 from Wehzie/big-refactor · c01d5bac
  Lintang Sutawika authored Aug 24, 2023
```
Update README.md
```
  c01d5bac
- Merge branch 'fix-metrics' of https://github.com/EleutherAI/lm-evaluation-harness into fix-metrics · f3a82004
  lintangsutawika authored Aug 23, 2023
  
  f3a82004
- fix condition where a benchmark and a regular task is called together · 2f0ef6ca
  lintangsutawika authored Aug 23, 2023
  
  2f0ef6ca
- Update README.md · 91d3f6c4
  Rafael Tappe Maestro authored Aug 23, 2023
```
fix broken link
```
  91d3f6c4
- Merge branch 'big-refactor' into fix-metrics · 45cc68ee
  USVSN SAI PRASHANTH authored Aug 23, 2023
  
  45cc68ee
- temp · 691b4ca9
  lintangsutawika authored Aug 23, 2023
  
  691b4ca9
- fix for choices · 32294ff1
  lintangsutawika authored Aug 23, 2023
  
  32294ff1
- temp · 18f7dfb3
  lintangsutawika authored Aug 23, 2023
  
  18f7dfb3
22 Aug, 2023 12 commits
- add multirc metrics · 8c93320a
  lintangsutawika authored Aug 22, 2023
  
  8c93320a
- add cb metrics · 4a768feb
  lintangsutawika authored Aug 22, 2023
  
  4a768feb
- fix test_choice test · 80d88899
  lintangsutawika authored Aug 22, 2023
  
  80d88899
- update yaml · f7a0235d
  lintangsutawika authored Aug 22, 2023
  
  f7a0235d
- added truncation option · d4e075e3
  lintangsutawika authored Aug 22, 2023
  
  d4e075e3
- add endspace · f96f5fad
  lintangsutawika authored Aug 22, 2023
  
  f96f5fad
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into superglue · bf4eb3e8
  lintangsutawika authored Aug 22, 2023
  
  bf4eb3e8
- add endspace · cc6662e1
  lintangsutawika authored Aug 22, 2023
  
  cc6662e1
- Merge pull request #780 from EleutherAI/fix-metrics · b5b01a49
  Lintang Sutawika authored Aug 22, 2023
```
[Refactor] Fix metrics in Greedy Until
```
  b5b01a49
- add to ignore.txt · 48e32540
  lintangsutawika authored Aug 22, 2023
  
  48e32540
- fix bleu · e3c70cad
  lintangsutawika authored Aug 22, 2023
  
  e3c70cad
- result is just 1 · 26196917
  lintangsutawika authored Aug 22, 2023
  
  26196917
21 Aug, 2023 1 commit
- no need to iterate over results for greedy_until · 4bba7abb
  lintangsutawika authored Aug 21, 2023
  
  4bba7abb