Commits · 37a463518aebdf099d2b1f55db66df8792151681 · gaoqiong / lm-evaluation-harness

28 Nov, 2023 9 commits
- reformat · 37a46351
  lintangsutawika authored Nov 28, 2023
  
  37a46351
- add documentation · 525afc17
  lintangsutawika authored Nov 28, 2023
  
  525afc17
- update version · 43f615c9
  lintangsutawika authored Nov 28, 2023
  
  43f615c9
- update version · 94cdface
  lintangsutawika authored Nov 28, 2023
  
  94cdface
- add versions · 0d03a9f3
  lintangsutawika authored Nov 28, 2023
  
  0d03a9f3
- Merge pull request #1029 from EleutherAI/bbh-fixup · bf26d979
  Lintang Sutawika authored Nov 28, 2023
```
[Refactor] BBH fixup
```
  bf26d979
- removed flan from the naming · 3b9640b8
  lintangsutawika authored Nov 28, 2023
  
  3b9640b8
- Merge pull request #1030 from EleutherAI/social-iqa · e7afee52
  Lintang Sutawika authored Nov 28, 2023
```
Social iqa
```
  e7afee52
- Update README.md · 00c05d63
  Stella Biderman authored Nov 27, 2023
  
  00c05d63
27 Nov, 2023 21 commits
- Update README.md · 5535fbd4
  Stella Biderman authored Nov 27, 2023
  
  5535fbd4
- Update README.md · 4706fbb2
  Stella Biderman authored Nov 27, 2023
  
  4706fbb2
- Create bigbench.yml · 11129906
  Stella Biderman authored Nov 27, 2023
  
  11129906
- Create README.md · babdc8d6
  Stella Biderman authored Nov 27, 2023
  
  babdc8d6
- 'flan' in groupnames optional for all variants · 1e5ca7a4
  haileyschoelkopf authored Nov 27, 2023
  
  1e5ca7a4
- make 'bbh' a group name for flan cot 3-shot, add stopseqs · e408c2ce
  haileyschoelkopf authored Nov 27, 2023
  
  e408c2ce
- Merge pull request #897 from EleutherAI/orz · b189066d
  Hailey Schoelkopf authored Nov 27, 2023
```
Allow Generation arguments on greedy_until reqs
```
  b189066d
- add --gen_kwargs to interface docs · d6653610
  haileyschoelkopf authored Nov 27, 2023
  
  d6653610
- Merge pull request #1011 from baberabb/big-refactor_vllm · a3d08277
  Hailey Schoelkopf authored Nov 27, 2023
```
[Refactor] vllm support
```
  a3d08277
- fixes for precommit · 4277dc35
  Hailey Schoelkopf authored Nov 27, 2023
  
  4277dc35
- fix precommint · 7fa49671
  baberabb authored Nov 27, 2023
  
  7fa49671
- skip vllm test (requires CUDA) · 05326b04
  baberabb authored Nov 27, 2023
  
  05326b04
- Update unit_tests.yml · b2282739
  Hailey Schoelkopf authored Nov 27, 2023
  
  b2282739
- Update vllm_causallms.py · 08074cf9
  Hailey Schoelkopf authored Nov 27, 2023
  
  08074cf9
- Add vLLM to README · 581dd9ff
  Hailey Schoelkopf authored Nov 27, 2023
  
  581dd9ff
- Fix gpu_memory_utilization kwarg typing, change to conditional import · b01c4893
  Hailey Schoelkopf authored Nov 27, 2023
  
  b01c4893
- always import vllm model · d86400b5
  Hailey Schoelkopf authored Nov 27, 2023
  
  d86400b5
- add auto batching · bbd6d051
  baberabb authored Nov 27, 2023
  
  bbd6d051
- add auto batching · 37f10cad
  baberabb authored Nov 27, 2023
  
  37f10cad
- lazy load import in tests · 2c20df08
  baberabb authored Nov 27, 2023
  
  2c20df08
- Add tests for VLLM · 026005ac
  baberabb authored Nov 27, 2023
  
  026005ac
26 Nov, 2023 2 commits
- Update README.md · 30936bc7
  Stella Biderman authored Nov 26, 2023
  
  30936bc7
- Update README.md · 8042479d
  Stella Biderman authored Nov 26, 2023
  
  8042479d
24 Nov, 2023 8 commits
- udate · a5b65c9b
  lintangsutawika authored Nov 24, 2023
  
  a5b65c9b
- fix missing lines · b64e592d
  lintangsutawika authored Nov 24, 2023
  
  b64e592d
- gen_kwargs is parsed once · 47933b98
  lintangsutawika authored Nov 24, 2023
  
  47933b98
- Merge pull request #1018 from EleutherAI/cleanup-examples · a2992d28
  Stella Biderman authored Nov 24, 2023
```
[Refactor] Remove `examples/` folder
```
  a2992d28
- update on args · fde2a1d5
  lintangsutawika authored Nov 24, 2023
  
  fde2a1d5
- merge conflict · 470059f6
  lintangsutawika authored Nov 24, 2023
  
  470059f6
- Merge pull request #1020 from baberabb/big-refactor-readme · 9d030712
  Hailey Schoelkopf authored Nov 23, 2023
```
[Refactor] Update README
```
  9d030712
- Update README.md · 4fd6a731
  Hailey Schoelkopf authored Nov 23, 2023
  
  4fd6a731