Commits · 815f59e69039b7d416e2bdf35164e36ab34a705e · gaoqiong / lm-evaluation-harness

06 Nov, 2023 4 commits
- Merge pull request #922 from EleutherAI/mmlu_subgroups · 815f59e6
  Lintang Sutawika authored Nov 06, 2023
```
[Refactor] Mmlu subgroups and weight avg
```
  815f59e6
- add space after - · 44124d95
  lintangsutawika authored Nov 06, 2023
  
  44124d95
- reformat · 491d4799
  lintangsutawika authored Nov 06, 2023
  
  491d4799
- remove samples in the table · 1e1dbaf3
  lintangsutawika authored Nov 06, 2023
  
  1e1dbaf3
04 Nov, 2023 1 commit
- Merge pull request #966 from EleutherAI/fix-verbose · 3533e4b9
  Stella Biderman authored Nov 03, 2023
```
[Refactor] Bugfix: AttributeError: 'Namespace' object has no attribute 'verbose'
```
  3533e4b9
03 Nov, 2023 4 commits
- fix bug with args.verbose · 5f3b8bf6
  haileyschoelkopf authored Nov 03, 2023
  
  5f3b8bf6
- Merge pull request #815 from EleutherAI/model-written-eval · 6f700f98
  Hailey Schoelkopf authored Nov 03, 2023
```
[Refactor] Model written eval
```
  6f700f98
- Update ignore.txt · 9f09016d
  Hailey Schoelkopf authored Nov 03, 2023
  
  9f09016d
- Update _generate_configs.py · 4d9b928e
  Hailey Schoelkopf authored Nov 03, 2023
  
  4d9b928e
02 Nov, 2023 9 commits
- Merge pull request #957 from EleutherAI/Refactor]-Patch-for-Generate-Until · c7b3f538
  Lintang Sutawika authored Nov 02, 2023
  
  c7b3f538
- Rename greedy_until_template_yaml to generate_until_template_yaml · 0d1fb8a5
  Lintang Sutawika authored Nov 02, 2023
  
  0d1fb8a5
- removed print · 6eac0056
  lintangsutawika authored Nov 02, 2023
  
  6eac0056
- merged conflicts · e49f2706
  lintangsutawika authored Nov 02, 2023
  
  e49f2706
- added group and task alias · 6dfe848e
  lintangsutawika authored Nov 02, 2023
  
  6dfe848e
- fixed stderr calculation · d1e7a30a
  lintangsutawika authored Nov 02, 2023
  
  d1e7a30a
- fixing display name · 29ba8cb1
  lintangsutawika authored Nov 02, 2023
  
  29ba8cb1
- Merge branch 'big-refactor' into model-written-eval · 2099099b
  Lintang Sutawika authored Nov 02, 2023
  
  2099099b
- Merge pull request #953 from EleutherAI/mmlu-no-train · ae74b808
  Lintang Sutawika authored Nov 02, 2023
```
[Refactor] Don't load MMLU auxiliary_train set
```
  ae74b808
01 Nov, 2023 18 commits
- Merge pull request #955 from EleutherAI/haileyschoelkopf-patch-2 · c4a3bbb2
  Stella Biderman authored Nov 01, 2023
```
[Refactor] Update README, documentation
```
  c4a3bbb2
- Merge pull request #956 from EleutherAI/haileyschoelkopf-patch-3 · 575dd0de
  Stella Biderman authored Nov 01, 2023
```
[Refactor] Describe local dataset usage in docs
```
  575dd0de
- Merge pull request #934 from AndyWolfZwei/andy/big-refactor-bugfixed · aff47420
  Hailey Schoelkopf authored Nov 01, 2023
```
[Refactor]fix two bugs when ran with qasper_bool and toxigen
```
  aff47420
- remove `--huggingface_login` · 4ac7f064
  Hailey Schoelkopf authored Nov 01, 2023
  
  4ac7f064
- describe local dataset usage in docs · 56a2c8e3
  Hailey Schoelkopf authored Nov 01, 2023
  
  56a2c8e3
- Update README.md · d50a2ad6
  Hailey Schoelkopf authored Nov 01, 2023
  
  d50a2ad6
- Update CODEOWNERS · 06faed0c
  Stella Biderman authored Nov 01, 2023
  
  06faed0c
- Update README.md · 70b09fd9
  Stella Biderman authored Nov 01, 2023
  
  70b09fd9
- Update README.md · 2efac405
  Stella Biderman authored Nov 01, 2023
  
  2efac405
- Update README.md · 7aad26fe
  Stella Biderman authored Nov 01, 2023
  
  7aad26fe
- Update README.md · 09a744b9
  Stella Biderman authored Nov 01, 2023
  
  09a744b9
- Merge pull request #954 from EleutherAI/update-docs · c9b76e69
  Stella Biderman authored Nov 01, 2023
```
[Refactor] Update documentation
```
  c9b76e69
- clean up documentation · 7fa0761c
  haileyschoelkopf authored Nov 01, 2023
  
  7fa0761c
- replace with no_train mmlu dataset · f5cf38a9
  haileyschoelkopf authored Nov 01, 2023
  
  f5cf38a9
- new way to display tasks · 60dd33c8
  lintangsutawika authored Nov 01, 2023
  
  60dd33c8
- new way to display tasks · f5bdefe8
  lintangsutawika authored Nov 01, 2023
  
  f5bdefe8
- Merge branch 'big-refactor' of... · a5d33ebe
  lintangsutawika authored Nov 01, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into mmlu_subgroups
```
  a5d33ebe
- add task and group alias · dd7002d6
  lintangsutawika authored Nov 01, 2023
  
  dd7002d6
31 Oct, 2023 2 commits
- Merge pull request #949 from EleutherAI/fix-whitespace-warning · 12fe236d
  Lintang Sutawika authored Nov 01, 2023
  
  12fe236d
- fix warning for delimiter having no whitespace · 888d3035
  haileyschoelkopf authored Oct 31, 2023
  
  888d3035
30 Oct, 2023 1 commit

Merge branch 'big-refactor' of... · 21cf6508

lintangsutawika authored Oct 30, 2023

Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into mmlu_subgroups

21cf6508

24 Oct, 2023 1 commit
- Merge pull request #915 from EleutherAI/package-patch · 06e69149
  Hailey Schoelkopf authored Oct 24, 2023
```
Update pyproject.toml
```
  06e69149