Commits · ce4d9c68040c3f747f25c677633053f4ed4bef8c · gaoqiong / lm-evaluation-harness

11 Dec, 2023 4 commits
- Delete lm_eval/tasks/glue/sst directory · ce4d9c68
  weijie authored Dec 11, 2023
  
  ce4d9c68
- Change the sub-task name from sst to sst2 in glue · dc556837
  weijie authored Dec 11, 2023
  
  dc556837
- Merge pull request #1097 from shiweijiezero/main · 09703d57
  Hailey Schoelkopf authored Dec 11, 2023
```
Update template of qqp dataset
```
  09703d57
- Update template of qqp dataset · 5dbdf582
  weijie authored Dec 11, 2023
  
  5dbdf582
09 Dec, 2023 1 commit
- Merge pull request #1077 from EleutherAI/patch-scrolls · 7003cddf
  Hailey Schoelkopf authored Dec 08, 2023
```
Patch scrolls
```
  7003cddf
07 Dec, 2023 11 commits
- Merge branch 'main' of https://github.com/EleutherAI/lm-evaluation-harness into patch-scrolls · eb834c98
  lintangsutawika authored Dec 07, 2023
  
  eb834c98
- fixed enumeration · 12f260cf
  lintangsutawika authored Dec 07, 2023
  
  12f260cf
- Merge pull request #1074 from EleutherAI/lintangsutawika-patch-4 · e5dfd030
  Lintang Sutawika authored Dec 07, 2023
```
Update _cot_fewshot_template_yaml
```
  e5dfd030
- formatting · 965c5330
  lintangsutawika authored Dec 07, 2023
  
  965c5330
- Update minerva_math_algebra.yaml · ce079c96
  Hailey Schoelkopf authored Dec 06, 2023
  
  ce079c96
- Update _cot_zeroshot_template_yaml · ba7ba910
  Hailey Schoelkopf authored Dec 06, 2023
  
  ba7ba910
- Update _fewshot_template_yaml · a2cc877b
  Hailey Schoelkopf authored Dec 06, 2023
  
  a2cc877b
- Update _zeroshot_template_yaml · 361ba192
  Hailey Schoelkopf authored Dec 06, 2023
  
  361ba192
- Update _mmlu_flan_cot_zeroshot_template_yaml · 8c05c6be
  Hailey Schoelkopf authored Dec 06, 2023
  
  8c05c6be
- Update _mmlu_flan_cot_fewshot_template_yaml · 4e34a6e8
  Hailey Schoelkopf authored Dec 06, 2023
  
  4e34a6e8
- Update _cot_fewshot_template_yaml · a6d28ea7
  Lintang Sutawika authored Dec 07, 2023
```
BBH cot fewshot already has fewshot examples in the description. So num_fewshot needs to be set to 0 so that users won't mistakenly set other num_fewshot values.
```
  a6d28ea7
04 Dec, 2023 24 commits
- Merge pull request #1063 from EleutherAI/haileyschoelkopf-patch-2 · f0b96491
  Stella Biderman authored Dec 04, 2023
```
Fiddling with READMEs, Reenable CI tests on `main`
```
  f0b96491
- Merge branch 'main' into haileyschoelkopf-patch-2 · f7fb109c
  Hailey Schoelkopf authored Dec 04, 2023
  
  f7fb109c
- update README.md · f721c0f0
  haileyschoelkopf authored Dec 04, 2023
  
  f721c0f0
- Unit tests run on `main` branch · f74c0feb
  Hailey Schoelkopf authored Dec 04, 2023
  
  f74c0feb
- run CI on `main` branch PRs · eeb99721
  Hailey Schoelkopf authored Dec 04, 2023
  
  eeb99721
- Merge pull request #1066 from EleutherAI/haileyschoelkopf-patch-4 · b957a080
  Hailey Schoelkopf authored Dec 04, 2023
```
Updating docs hyperlinks 
```
  b957a080
- Update model_guide.md · d83fc511
  Hailey Schoelkopf authored Dec 04, 2023
  
  d83fc511
- Update new_task_guide.md · f73c2bc8
  Hailey Schoelkopf authored Dec 04, 2023
  
  f73c2bc8
- Merge pull request #1064 from EleutherAI/haileyschoelkopf-patch-3 · 6f76ee0e
  Lintang Sutawika authored Dec 04, 2023
  
  6f76ee0e
- Merge pull request #1065 from EleutherAI/haileyschoelkopf-patch-4 · f55595c8
  Lintang Sutawika authored Dec 04, 2023
  
  f55595c8
- Update interface.md · 05835d41
  Hailey Schoelkopf authored Dec 04, 2023
  
  05835d41
- Update README.md · ab7e8192
  Stella Biderman authored Dec 04, 2023
  
  ab7e8192
- Update pyproject.toml · 4efa4a54
  Hailey Schoelkopf authored Dec 04, 2023
  
  4efa4a54
- test · c1c44651
  Stella Biderman authored Dec 04, 2023
  
  c1c44651
- Update README.md · 296732d4
  Hailey Schoelkopf authored Dec 04, 2023
  
  296732d4
- Merge pull request #1062 from EleutherAI/haileyschoelkopf-patch-2 · 3c75a2c7
  Lintang Sutawika authored Dec 04, 2023
  
  3c75a2c7
- minor readme updates due to refacotr · 15953e42
  Stella Biderman authored Dec 04, 2023
  
  15953e42
- Update samplers.py · 3512f742
  Hailey Schoelkopf authored Dec 04, 2023
  
  3512f742
- Merge pull request #1061 from EleutherAI/haileyschoelkopf-patch-2 · fde2b77e
  Lintang Sutawika authored Dec 04, 2023
  
  fde2b77e
- Update README.md · dea8d7bd
  Hailey Schoelkopf authored Dec 04, 2023
  
  dea8d7bd
- Merge pull request #1060 from EleutherAI/fix-mmlu · c9bbec6e
  Hailey Schoelkopf authored Dec 04, 2023
```
[Refactor] Fix fewshot cot mmlu descriptions
```
  c9bbec6e
- formatting · 57e017ff
  lintangsutawika authored Dec 04, 2023
  
  57e017ff
- add \n\n to end of description · c30b71c3
  lintangsutawika authored Dec 04, 2023
  
  c30b71c3
- add \n\n to end of description · b32b3793
  lintangsutawika authored Dec 04, 2023
  
  b32b3793