Commits · 7601d82827abfeb60288e1c561e8ac518a5b4d0d · gaoqiong / lm-evaluation-harness

05 Sep, 2023 1 commit
- edit to fix cot filter · 7601d828
  lintangsutawika authored Sep 05, 2023
  
  7601d828
04 Sep, 2023 14 commits
- add codexglue · 8c39bfc7
  lintangsutawika authored Sep 04, 2023
  
  8c39bfc7
- update for held-in tasks · ec03783f
  lintangsutawika authored Sep 04, 2023
  
  ec03783f
- fixed template · 4f5b72bc
  lintangsutawika authored Sep 04, 2023
  
  4f5b72bc
- update flan mmlu · 4a752867
  lintangsutawika authored Sep 04, 2023
  
  4a752867
- udpate · 03be40e2
  lintangsutawika authored Sep 04, 2023
  
  03be40e2
- updates · e795efcf
  lintangsutawika authored Sep 04, 2023
  
  e795efcf
- edit group name · c8b76a3d
  lintangsutawika authored Sep 04, 2023
  
  c8b76a3d
- update benchmarks · 96d9e38c
  lintangsutawika authored Sep 04, 2023
  
  96d9e38c
- modified changes to fix loglikelihood prediction for seq2seq · 86e78589
  lintangsutawika authored Sep 04, 2023
  
  86e78589
- add flan_zeroshot · 0d195e90
  lintangsutawika authored Sep 04, 2023
  
  0d195e90
- add flan_fewshot · 3531d9c1
  lintangsutawika authored Sep 04, 2023
  
  3531d9c1
- add flan_cot_zeroshot · c06b0d6e
  lintangsutawika authored Sep 04, 2023
  
  c06b0d6e
- add bbh flan_cot_fewshot · 13940f1e
  lintangsutawika authored Sep 04, 2023
  
  13940f1e
- update · 06d3406e
  lintangsutawika authored Sep 04, 2023
  
  06d3406e
03 Sep, 2023 1 commit
- add mmlu variants · f23ae748
  lintangsutawika authored Sep 03, 2023
  
  f23ae748
02 Sep, 2023 1 commit

Merge branch 'mmlu-refactorbranch' of... · 191458b8

lintangsutawika authored Sep 02, 2023

Merge branch 'mmlu-refactorbranch' of https://github.com/EleutherAI/lm-evaluation-harness into flan-benchmark

191458b8

01 Sep, 2023 1 commit
- edit stop token · a81ef1a7
  lintangsutawika authored Sep 01, 2023
  
  a81ef1a7
31 Aug, 2023 1 commit
- update to generate bbh configs · c3764d2c
  lintangsutawika authored Aug 31, 2023
  
  c3764d2c
30 Aug, 2023 19 commits
- added more flan subtasks · 525f1d15
  lintangsutawika authored Aug 30, 2023
  
  525f1d15
- add bbh · 24754ee4
  lintangsutawika authored Aug 30, 2023
  
  24754ee4
- Merge branch 'big-refactor' of... · 88e1cdb0
  lintangsutawika authored Aug 30, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into flan-benchmark
```
  88e1cdb0
- Merge pull request #819 from EleutherAI/811-fix-indexerror · 6342636e
  Lintang Sutawika authored Aug 30, 2023
```
[Refactor] Fix IndexError
```
  6342636e
- Merge pull request #813 from EleutherAI/asdiv · dc544beb
  Lintang Sutawika authored Aug 30, 2023
```
[Refactor] Asdiv
```
  dc544beb
- Update task.py · ebfff08f
  Lintang Sutawika authored Aug 30, 2023
  
  ebfff08f
- Merge pull request #821 from EleutherAI/drop · 084a9119
  Lintang Sutawika authored Aug 30, 2023
```
[Refactor] drop
```
  084a9119
- Merge branch 'big-refactor' into drop · 33137b36
  Lintang Sutawika authored Aug 30, 2023
  
  33137b36
- Update task.py · 8d1d003d
  Lintang Sutawika authored Aug 30, 2023
  
  8d1d003d
- Merge pull request #820 from EleutherAI/coqa · b5ed3a9b
  Lintang Sutawika authored Aug 30, 2023
```
[Refactor] Coqa
```
  b5ed3a9b
- checked coqa on readme · 8287fe7c
  lintangsutawika authored Aug 30, 2023
  
  8287fe7c
- fix formatting · f555a583
  lintangsutawika authored Aug 30, 2023
  
  f555a583
- running process for drop · 79aa53b1
  lintangsutawika authored Aug 30, 2023
  
  79aa53b1
- add coqa · 64d4600c
  lintangsutawika authored Aug 30, 2023
  
  64d4600c
- add drop · f9558ce5
  lintangsutawika authored Aug 30, 2023
  
  f9558ce5
- reformat · cddbf9f6
  lintangsutawika authored Aug 30, 2023
  
  cddbf9f6
- added checks for if gold is outside choice options · 65e5bc69
  lintangsutawika authored Aug 30, 2023
  
  65e5bc69
- moved benchmark up · c0cb0be7
  lintangsutawika authored Aug 30, 2023
  
  c0cb0be7
- updated yaml templates · 0a5bd869
  lintangsutawika authored Aug 30, 2023
  
  0a5bd869
29 Aug, 2023 2 commits
- Merge pull request #817 from EleutherAI/lintangsutawika-patch-2 · c052637f
  Lintang Sutawika authored Aug 30, 2023
  
  c052637f
- moved templates, edit templates · 7e875dcf
  lintangsutawika authored Aug 29, 2023
  
  7e875dcf