Commits · a3d082778e84f8f708cf849ece855d4a4dab5fc0 · gaoqiong / lm-evaluation-harness

27 Nov, 2023 13 commits
- Merge pull request #1011 from baberabb/big-refactor_vllm · a3d08277
  Hailey Schoelkopf authored Nov 27, 2023
```
[Refactor] vllm support
```
  a3d08277
- fixes for precommit · 4277dc35
  Hailey Schoelkopf authored Nov 27, 2023
  
  4277dc35
- fix precommint · 7fa49671
  baberabb authored Nov 27, 2023
  
  7fa49671
- skip vllm test (requires CUDA) · 05326b04
  baberabb authored Nov 27, 2023
  
  05326b04
- Update unit_tests.yml · b2282739
  Hailey Schoelkopf authored Nov 27, 2023
  
  b2282739
- Update vllm_causallms.py · 08074cf9
  Hailey Schoelkopf authored Nov 27, 2023
  
  08074cf9
- Add vLLM to README · 581dd9ff
  Hailey Schoelkopf authored Nov 27, 2023
  
  581dd9ff
- Fix gpu_memory_utilization kwarg typing, change to conditional import · b01c4893
  Hailey Schoelkopf authored Nov 27, 2023
  
  b01c4893
- always import vllm model · d86400b5
  Hailey Schoelkopf authored Nov 27, 2023
  
  d86400b5
- add auto batching · bbd6d051
  baberabb authored Nov 27, 2023
  
  bbd6d051
- add auto batching · 37f10cad
  baberabb authored Nov 27, 2023
  
  37f10cad
- lazy load import in tests · 2c20df08
  baberabb authored Nov 27, 2023
  
  2c20df08
- Add tests for VLLM · 026005ac
  baberabb authored Nov 27, 2023
  
  026005ac
26 Nov, 2023 2 commits
- Update README.md · 30936bc7
  Stella Biderman authored Nov 26, 2023
  
  30936bc7
- Update README.md · 8042479d
  Stella Biderman authored Nov 26, 2023
  
  8042479d
24 Nov, 2023 3 commits
- Merge pull request #1018 from EleutherAI/cleanup-examples · a2992d28
  Stella Biderman authored Nov 24, 2023
```
[Refactor] Remove `examples/` folder
```
  a2992d28
- Merge pull request #1020 from baberabb/big-refactor-readme · 9d030712
  Hailey Schoelkopf authored Nov 23, 2023
```
[Refactor] Update README
```
  9d030712
- Update README.md · 4fd6a731
  Hailey Schoelkopf authored Nov 23, 2023
  
  4fd6a731
23 Nov, 2023 2 commits
- Update README with additional usage instructions. · d3e46bb3
  baberabb authored Nov 23, 2023
  
  d3e46bb3
- Merge pull request #1009 from EleutherAI/fix-stopseqs · 50107e10
  Stella Biderman authored Nov 23, 2023
```
[Refactor] Improve Handling of Stop-Sequences for HF Batched Generation
```
  50107e10
22 Nov, 2023 11 commits
- fix args · 4f79fa7b
  baberabb authored Nov 23, 2023
  
  4f79fa7b
- Update vllm compatibility in README. · 953bfdd2
  baberabb authored Nov 23, 2023
  
  953bfdd2
- add dependency · b570fce7
  baberabb authored Nov 23, 2023
  
  b570fce7
- fix tensor parallel · af884028
  baberabb authored Nov 23, 2023
  
  af884028
- fix imports · 5ba54539
  baberabb authored Nov 23, 2023
  
  5ba54539
- fix imports · ce164bb1
  baberabb authored Nov 23, 2023
  
  ce164bb1
- disable tqdm · 667fc837
  baberabb authored Nov 23, 2023
  
  667fc837
- fix logliklehood_rolling · ac664bce
  baberabb authored Nov 23, 2023
  
  ac664bce
- remove examples/ subdir · 9c7cfcee
  haileyschoelkopf authored Nov 22, 2023
  
  9c7cfcee
- bugfix · 2362ab41
  baberabb authored Nov 22, 2023
  
  2362ab41
- fix greedy_until · e5491709
  baberabb authored Nov 22, 2023
  
  e5491709
21 Nov, 2023 9 commits
- Update model_guide.md · a1403c8f
  Stella Biderman authored Nov 21, 2023
  
  a1403c8f
- (temp) fix import · 24f4e8d7
  baberabb authored Nov 22, 2023
  
  24f4e8d7
- bugfix · f2890cc1
  baberabb authored Nov 22, 2023
  
  f2890cc1
- Merge remote-tracking branch 'origin/big-refactor' into big-refactor_vllm · 91868979
  baberabb authored Nov 22, 2023
```
# Conflicts:
#	lm_eval/models/__init__.py
```
  91868979
- bugfix · 0635af13
  baberabb authored Nov 22, 2023
  
  0635af13
- bugfix · 103a10e3
  baberabb authored Nov 21, 2023
  
  103a10e3
- add vllm model · a2920e3d
  baberabb authored Nov 21, 2023
  
  a2920e3d
- Merge pull request #967 from EleutherAI/upstream-ggml · 815cd29d
  Hailey Schoelkopf authored Nov 21, 2023
```
[Refactor] Upstream ggml from big-refactor branch
```
  815cd29d
- add vllm model · 3d8bc82f
  baberabb authored Nov 21, 2023
  
  3d8bc82f