Commits · 24f4e8d7be53afa0ec119b854a4f20b27bcc71fa · gaoqiong / lm-evaluation-harness

"llama/vscode:/vscode.git/clone" did not exist on "f2890a4494f9fb3722ee7a4c506252362d1eab65"

21 Nov, 2023 8 commits
- (temp) fix import · 24f4e8d7
  baberabb authored Nov 22, 2023
  
  24f4e8d7
- bugfix · f2890cc1
  baberabb authored Nov 22, 2023
  
  f2890cc1
- Merge remote-tracking branch 'origin/big-refactor' into big-refactor_vllm · 91868979
  baberabb authored Nov 22, 2023
```
# Conflicts:
#	lm_eval/models/__init__.py
```
  91868979
- bugfix · 0635af13
  baberabb authored Nov 22, 2023
  
  0635af13
- bugfix · 103a10e3
  baberabb authored Nov 21, 2023
  
  103a10e3
- add vllm model · a2920e3d
  baberabb authored Nov 21, 2023
  
  a2920e3d
- Merge pull request #967 from EleutherAI/upstream-ggml · 815cd29d
  Hailey Schoelkopf authored Nov 21, 2023
```
[Refactor] Upstream ggml from big-refactor branch
```
  815cd29d
- add vllm model · 3d8bc82f
  baberabb authored Nov 21, 2023
  
  3d8bc82f
20 Nov, 2023 4 commits
- Merge pull request #979 from EleutherAI/benchmark-documentation · e3644fcc
  Stella Biderman authored Nov 20, 2023
```
add description on task/group alias
```
  e3644fcc
- add ggml tests · f87b864f
  haileyschoelkopf authored Nov 20, 2023
  
  f87b864f
- add typehints · 1e9c8b59
  baberabb authored Nov 20, 2023
  
  1e9c8b59
- add docs · b22f3440
  baberabb authored Nov 20, 2023
  
  b22f3440
17 Nov, 2023 24 commits
- Merge pull request #958 from EleutherAI/verbosity-rework · afda6551
  Hailey Schoelkopf authored Nov 17, 2023
```
[Refactor] Verbosity rework
```
  afda6551
- add initialize_tasks() to interface guide in docs · 9b596e8f
  haileyschoelkopf authored Nov 17, 2023
  
  9b596e8f
- initialize tasks in test files · 032820dd
  haileyschoelkopf authored Nov 17, 2023
  
  032820dd
- Merge pull request #1002 from EleutherAI/bugfixes-bigrefactor · 2c0c345a
  Hailey Schoelkopf authored Nov 17, 2023
```
[Refactor] Bugfixes
```
  2c0c345a
- update bigbench datasets to mirror, rename groupnames · 487767ab
  haileyschoelkopf authored Nov 17, 2023
  
  487767ab
- fix error when using wildcard task names · 2444b364
  haileyschoelkopf authored Nov 17, 2023
  
  2444b364
- fix error when using wildcard task names · aa9e1062
  haileyschoelkopf authored Nov 17, 2023
  
  aa9e1062
- Merge branch 'verbosity-rework' of... · c0000e03
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'verbosity-rework' of https://github.com/EleutherAI/lm-evaluation-harness into verbosity-rework
```
  c0000e03
- update script to use initialize_tasks · 66eed4bb
  lintangsutawika authored Nov 17, 2023
  
  66eed4bb
- merge cnflict resolved · a58674ae
  lintangsutawika authored Nov 17, 2023
  
  a58674ae
- Merge branch 'big-refactor' into verbosity-rework · 115b2bd4
  Lintang Sutawika authored Nov 17, 2023
  
  115b2bd4
- Merge pull request #1001 from EleutherAI/fix-alias · f76941ef
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] will check if group_name is None
```
  f76941ef
- Merge pull request #997 from EleutherAI/fix-tests-refactor · 056569e5
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] Fix CI tests
```
  056569e5
- format · bf6cf1de
  lintangsutawika authored Nov 17, 2023
  
  bf6cf1de
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into fix-alias · b4c1ba30
  lintangsutawika authored Nov 17, 2023
  
  b4c1ba30
- will check if group_name is None · 2314ff4f
  lintangsutawika authored Nov 17, 2023
  
  2314ff4f
- Merge pull request #999 from EleutherAI/port_master_squadv2 · 84c2cda9
  Lintang Sutawika authored Nov 17, 2023
  
  84c2cda9
- precommit · f40b7d0e
  lintangsutawika authored Nov 17, 2023
  
  f40b7d0e
- Merge pull request #971 from EleutherAI/port_master_squadv2 · f7ba0d63
  Lintang Sutawika authored Nov 17, 2023
  
  f7ba0d63
- removed provide_description arg · 0d209e2e
  lintangsutawika authored Nov 17, 2023
  
  0d209e2e
- Merge branch 'port_master_squadv2' of... · f56e2c47
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'port_master_squadv2' of https://github.com/EleutherAI/lm-evaluation-harness into port_master_squadv2
```
  f56e2c47
- Merge pull request #996 from EleutherAI/update-pytask · acda980f
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] Minor cleanup on base `Task` subclasses
```
  acda980f
- edits and format · 10cc0a56
  lintangsutawika authored Nov 17, 2023
  
  10cc0a56
- Merge branch 'big-refactor' of... · cfbad4c4
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into verbosity-rework
```
  cfbad4c4
16 Nov, 2023 3 commits
- widen HF model test tolerance · 57ce579c
  haileyschoelkopf authored Nov 16, 2023
  
  57ce579c
- update gsm8k name · 1eed1cb5
  haileyschoelkopf authored Nov 16, 2023
  
  1eed1cb5
- remove provide_description flag · a745d589
  haileyschoelkopf authored Nov 16, 2023
  
  a745d589
15 Nov, 2023 1 commit
- update squad file · c9a3fd3f
  lintangsutawika authored Nov 15, 2023
  
  c9a3fd3f