Commits · 306e84fb74b5409fd3290fa2fc02c5be64c95efc · gaoqiong / lm-evaluation-harness

"src/targets/vscode:/vscode.git/clone" did not exist on "52ed1fc3c9b7f5138c5eabb2d04bd1aa5365fd7f"

27 Nov, 2023 1 commit
- readd old completion api · 306e84fb
  lintangsutawika authored Nov 27, 2023
  
  306e84fb
24 Nov, 2023 1 commit
- update · 30296795
  lintangsutawika authored Nov 24, 2023
  
  30296795
21 Nov, 2023 4 commits
- fixed parsing of API returns · 12e92616
  lintangsutawika authored Nov 21, 2023
  
  12e92616
- API update · bfe69313
  lintangsutawika authored Nov 21, 2023
  
  bfe69313
- Merge branch 'big-refactor' of... · 6ac42518
  lintangsutawika authored Nov 21, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into openai_completions
```
  6ac42518
- renamed greedy_until to generate_until · 9c3ba7d4
  lintangsutawika authored Nov 21, 2023
  
  9c3ba7d4
20 Nov, 2023 1 commit
- Merge pull request #979 from EleutherAI/benchmark-documentation · e3644fcc
  Stella Biderman authored Nov 20, 2023
```
add description on task/group alias
```
  e3644fcc
17 Nov, 2023 24 commits
- Merge pull request #958 from EleutherAI/verbosity-rework · afda6551
  Hailey Schoelkopf authored Nov 17, 2023
```
[Refactor] Verbosity rework
```
  afda6551
- add initialize_tasks() to interface guide in docs · 9b596e8f
  haileyschoelkopf authored Nov 17, 2023
  
  9b596e8f
- initialize tasks in test files · 032820dd
  haileyschoelkopf authored Nov 17, 2023
  
  032820dd
- Merge pull request #1002 from EleutherAI/bugfixes-bigrefactor · 2c0c345a
  Hailey Schoelkopf authored Nov 17, 2023
```
[Refactor] Bugfixes
```
  2c0c345a
- update bigbench datasets to mirror, rename groupnames · 487767ab
  haileyschoelkopf authored Nov 17, 2023
  
  487767ab
- fix error when using wildcard task names · 2444b364
  haileyschoelkopf authored Nov 17, 2023
  
  2444b364
- fix error when using wildcard task names · aa9e1062
  haileyschoelkopf authored Nov 17, 2023
  
  aa9e1062
- Merge branch 'verbosity-rework' of... · c0000e03
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'verbosity-rework' of https://github.com/EleutherAI/lm-evaluation-harness into verbosity-rework
```
  c0000e03
- update script to use initialize_tasks · 66eed4bb
  lintangsutawika authored Nov 17, 2023
  
  66eed4bb
- merge cnflict resolved · a58674ae
  lintangsutawika authored Nov 17, 2023
  
  a58674ae
- Merge branch 'big-refactor' into verbosity-rework · 115b2bd4
  Lintang Sutawika authored Nov 17, 2023
  
  115b2bd4
- Merge pull request #1001 from EleutherAI/fix-alias · f76941ef
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] will check if group_name is None
```
  f76941ef
- Merge pull request #997 from EleutherAI/fix-tests-refactor · 056569e5
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] Fix CI tests
```
  056569e5
- format · bf6cf1de
  lintangsutawika authored Nov 17, 2023
  
  bf6cf1de
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into fix-alias · b4c1ba30
  lintangsutawika authored Nov 17, 2023
  
  b4c1ba30
- will check if group_name is None · 2314ff4f
  lintangsutawika authored Nov 17, 2023
  
  2314ff4f
- Merge pull request #999 from EleutherAI/port_master_squadv2 · 84c2cda9
  Lintang Sutawika authored Nov 17, 2023
  
  84c2cda9
- precommit · f40b7d0e
  lintangsutawika authored Nov 17, 2023
  
  f40b7d0e
- Merge pull request #971 from EleutherAI/port_master_squadv2 · f7ba0d63
  Lintang Sutawika authored Nov 17, 2023
  
  f7ba0d63
- removed provide_description arg · 0d209e2e
  lintangsutawika authored Nov 17, 2023
  
  0d209e2e
- Merge branch 'port_master_squadv2' of... · f56e2c47
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'port_master_squadv2' of https://github.com/EleutherAI/lm-evaluation-harness into port_master_squadv2
```
  f56e2c47
- Merge pull request #996 from EleutherAI/update-pytask · acda980f
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] Minor cleanup on base `Task` subclasses
```
  acda980f
- edits and format · 10cc0a56
  lintangsutawika authored Nov 17, 2023
  
  10cc0a56
- Merge branch 'big-refactor' of... · cfbad4c4
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into verbosity-rework
```
  cfbad4c4
16 Nov, 2023 3 commits
- widen HF model test tolerance · 57ce579c
  haileyschoelkopf authored Nov 16, 2023
  
  57ce579c
- update gsm8k name · 1eed1cb5
  haileyschoelkopf authored Nov 16, 2023
  
  1eed1cb5
- remove provide_description flag · a745d589
  haileyschoelkopf authored Nov 16, 2023
  
  a745d589
15 Nov, 2023 2 commits
- update squad file · c9a3fd3f
  lintangsutawika authored Nov 15, 2023
  
  c9a3fd3f
- Merge branch 'big-refactor' of... · 5a4fc8fb
  lintangsutawika authored Nov 15, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into port_master_squadv2
```
  5a4fc8fb
14 Nov, 2023 3 commits
- Merge pull request #987 from EleutherAI/alias-fix · e35b0667
  Hailey Schoelkopf authored Nov 14, 2023
```
[Refactor] Alias fix
```
  e35b0667
- removed unused variables · d9230aa8
  lintangsutawika authored Nov 14, 2023
  
  d9230aa8
- enables tasks of different group but same task_alis (for example, if... · 7760573f
  lintangsutawika authored Nov 14, 2023
```
enables tasks of different group but same task_alis (for example, if evaluating on different versions of MMLU
```
  7760573f
10 Nov, 2023 1 commit
- Merge pull request #981 from EleutherAI/mmlu-fixes · 8ffd2630
  Hailey Schoelkopf authored Nov 10, 2023
```
[Refactor] fixes for alternative MMLU tasks.
```
  8ffd2630