Commits · d665361002bba0a97a05df689480984452fccbb3 · gaoqiong / lm-evaluation-harness

27 Nov, 2023 1 commit
- add --gen_kwargs to interface docs · d6653610
  haileyschoelkopf authored Nov 27, 2023
  
  d6653610
24 Nov, 2023 7 commits
- udate · a5b65c9b
  lintangsutawika authored Nov 24, 2023
  
  a5b65c9b
- fix missing lines · b64e592d
  lintangsutawika authored Nov 24, 2023
  
  b64e592d
- gen_kwargs is parsed once · 47933b98
  lintangsutawika authored Nov 24, 2023
  
  47933b98
- update on args · fde2a1d5
  lintangsutawika authored Nov 24, 2023
  
  fde2a1d5
- merge conflict · 470059f6
  lintangsutawika authored Nov 24, 2023
  
  470059f6
- Merge pull request #1020 from baberabb/big-refactor-readme · 9d030712
  Hailey Schoelkopf authored Nov 23, 2023
```
[Refactor] Update README
```
  9d030712
- Update README.md · 4fd6a731
  Hailey Schoelkopf authored Nov 23, 2023
  
  4fd6a731
23 Nov, 2023 2 commits
- Update README with additional usage instructions. · d3e46bb3
  baberabb authored Nov 23, 2023
  
  d3e46bb3
- Merge pull request #1009 from EleutherAI/fix-stopseqs · 50107e10
  Stella Biderman authored Nov 23, 2023
```
[Refactor] Improve Handling of Stop-Sequences for HF Batched Generation
```
  50107e10
21 Nov, 2023 3 commits
- Update model_guide.md · a1403c8f
  Stella Biderman authored Nov 21, 2023
  
  a1403c8f
- Merge pull request #967 from EleutherAI/upstream-ggml · 815cd29d
  Hailey Schoelkopf authored Nov 21, 2023
```
[Refactor] Upstream ggml from big-refactor branch
```
  815cd29d
- update multi-token stopsequence handling · f7873a49
  haileyschoelkopf authored Nov 21, 2023
  
  f7873a49
20 Nov, 2023 2 commits
- Merge pull request #979 from EleutherAI/benchmark-documentation · e3644fcc
  Stella Biderman authored Nov 20, 2023
```
add description on task/group alias
```
  e3644fcc
- add ggml tests · f87b864f
  haileyschoelkopf authored Nov 20, 2023
  
  f87b864f
17 Nov, 2023 24 commits
- Merge pull request #958 from EleutherAI/verbosity-rework · afda6551
  Hailey Schoelkopf authored Nov 17, 2023
```
[Refactor] Verbosity rework
```
  afda6551
- add initialize_tasks() to interface guide in docs · 9b596e8f
  haileyschoelkopf authored Nov 17, 2023
  
  9b596e8f
- initialize tasks in test files · 032820dd
  haileyschoelkopf authored Nov 17, 2023
  
  032820dd
- Merge pull request #1002 from EleutherAI/bugfixes-bigrefactor · 2c0c345a
  Hailey Schoelkopf authored Nov 17, 2023
```
[Refactor] Bugfixes
```
  2c0c345a
- update bigbench datasets to mirror, rename groupnames · 487767ab
  haileyschoelkopf authored Nov 17, 2023
  
  487767ab
- fix error when using wildcard task names · 2444b364
  haileyschoelkopf authored Nov 17, 2023
  
  2444b364
- fix error when using wildcard task names · aa9e1062
  haileyschoelkopf authored Nov 17, 2023
  
  aa9e1062
- Merge branch 'verbosity-rework' of... · c0000e03
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'verbosity-rework' of https://github.com/EleutherAI/lm-evaluation-harness into verbosity-rework
```
  c0000e03
- update script to use initialize_tasks · 66eed4bb
  lintangsutawika authored Nov 17, 2023
  
  66eed4bb
- merge cnflict resolved · a58674ae
  lintangsutawika authored Nov 17, 2023
  
  a58674ae
- Merge branch 'big-refactor' into verbosity-rework · 115b2bd4
  Lintang Sutawika authored Nov 17, 2023
  
  115b2bd4
- Merge pull request #1001 from EleutherAI/fix-alias · f76941ef
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] will check if group_name is None
```
  f76941ef
- Merge pull request #997 from EleutherAI/fix-tests-refactor · 056569e5
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] Fix CI tests
```
  056569e5
- format · bf6cf1de
  lintangsutawika authored Nov 17, 2023
  
  bf6cf1de
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into fix-alias · b4c1ba30
  lintangsutawika authored Nov 17, 2023
  
  b4c1ba30
- will check if group_name is None · 2314ff4f
  lintangsutawika authored Nov 17, 2023
  
  2314ff4f
- Merge pull request #999 from EleutherAI/port_master_squadv2 · 84c2cda9
  Lintang Sutawika authored Nov 17, 2023
  
  84c2cda9
- precommit · f40b7d0e
  lintangsutawika authored Nov 17, 2023
  
  f40b7d0e
- Merge pull request #971 from EleutherAI/port_master_squadv2 · f7ba0d63
  Lintang Sutawika authored Nov 17, 2023
  
  f7ba0d63
- removed provide_description arg · 0d209e2e
  lintangsutawika authored Nov 17, 2023
  
  0d209e2e
- Merge branch 'port_master_squadv2' of... · f56e2c47
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'port_master_squadv2' of https://github.com/EleutherAI/lm-evaluation-harness into port_master_squadv2
```
  f56e2c47
- Merge pull request #996 from EleutherAI/update-pytask · acda980f
  Lintang Sutawika authored Nov 17, 2023
```
[Refactor] Minor cleanup on base `Task` subclasses
```
  acda980f
- edits and format · 10cc0a56
  lintangsutawika authored Nov 17, 2023
  
  10cc0a56
- Merge branch 'big-refactor' of... · cfbad4c4
  lintangsutawika authored Nov 17, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into verbosity-rework
```
  cfbad4c4
16 Nov, 2023 1 commit
- widen HF model test tolerance · 57ce579c
  haileyschoelkopf authored Nov 16, 2023
  
  57ce579c