Commits · 220a47627bf48c728ce0a2737be39c400bb6f653 · SIYIXNI / vllm

"docs/source/en/api/pipelines/shap_e.md" did not exist on "746215670a61af1034c470d0b6555be9c60cb7b6"

27 Jan, 2024 2 commits
- Use head_dim in config if exists (#2622) · 220a4762
  Xiang Xu authored Jan 27, 2024
  
  220a4762
- AWQ: Up to 2.66x higher throughput (#2566) · beb89f68
  Casper authored Jan 27, 2024
  
  beb89f68
26 Jan, 2024 4 commits
- Don't build punica kernels by default (#2605) · 390b495f
  Philipp Moritz authored Jan 26, 2024
  
  390b495f
- Support for Stable LM 2 (#2598) · 3a0e1fc0
  dakotamahan-stability authored Jan 26, 2024
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  3a0e1fc0
- [ROCm] add support to ROCm 6.0 and MI300 (#2274) · 6b7de1a0
  Hongxia Yang authored Jan 26, 2024
  
  6b7de1a0
- use a correct device when creating OptionalCUDAGuard (#2583) · 5265631d
  Vladimir authored Jan 26, 2024
  
  5265631d
25 Jan, 2024 2 commits
- fix names and license for Qwen2 (#2589) · 2832e7b9
  Junyang Lin authored Jan 25, 2024
  
  2832e7b9
- Support Batch Completion in Server (#2529) · 3a7dd7e3
  Simon Mo authored Jan 24, 2024
  
  3a7dd7e3
24 Jan, 2024 3 commits
- Fix the syntax error in the doc of supported_models (#2584) · 223c1922
  LastWhisper authored Jan 25, 2024
  
  223c1922
- Added `include_stop_str_in_output` and `length_penalty` parameters to OpenAI API (#2562) · f1f6cc10
  Federico Galatolo authored Jan 24, 2024
  
  f1f6cc10
- [Bugfix] fix crash if max_tokens=None (#2570) · 3209b490
  Nikola Borisov authored Jan 23, 2024
  
  3209b490
23 Jan, 2024 3 commits
- lint: format all python file instead of just source code (#2567) · 1e4277d2
  Simon Mo authored Jan 23, 2024
  
  1e4277d2
- [Experimental] Add multi-LoRA support (#1804) · 9b945daa
  Antoni Baum authored Jan 24, 2024
```
Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>
```
  9b945daa
- [Feature] Simple API token authentication and pluggable middlewares (#1106) · 9c1352eb
  Erfan Al-Hossami authored Jan 23, 2024
  
  9c1352eb
22 Jan, 2024 6 commits
- Add a 1-line docstring to explain why calling context_attention_fwd twice in... · 7a0b011d
  Jason Zhu authored Jan 22, 2024
```
Add a 1-line docstring to explain why calling context_attention_fwd twice in test_prefix_prefill.py (#2553)
```
  7a0b011d
- Fix progress bar and allow HTTPS in `benchmark_serving.py` (#2552) · 63e835cb
  Harry Mellor authored Jan 22, 2024
  
  63e835cb
- Add qwen2 (#2495) · 94b5edeb
  Junyang Lin authored Jan 23, 2024
  
  94b5edeb
- Fix https://github.com/vllm-project/vllm/issues/2540 (#2545) · ab7e6006
  Philipp Moritz authored Jan 22, 2024
  
  ab7e6006
- [Speculative decoding 2/9] Multi-step worker for draft model (#2424) · 18bfcdd0
  Cade Daniel authored Jan 21, 2024
  
  18bfcdd0
- migrate pydantic from v1 to v2 (#2531) · 71d63ed7
  Jannis Schönleber authored Jan 22, 2024
  
  71d63ed7
21 Jan, 2024 2 commits
- [Fix] Keep `scheduler.running` as deque (#2523) · d75c4073
  Nick Hill authored Jan 20, 2024
  
  d75c4073
- Add `group` as an argument in broadcast ops (#2522) · 5b23c3f2
  Junda Chen authored Jan 20, 2024
  
  5b23c3f2
20 Jan, 2024 2 commits
- Add benchmark serving to CI (#2505) · 00efdc84
  Simon Mo authored Jan 19, 2024
  
  00efdc84
- [Bugfix] fix load local safetensors model (#2512) · 91a61da9
  Roy authored Jan 20, 2024
  
  91a61da9
19 Jan, 2024 3 commits
- Simplify broadcast logic for control messages (#2501) · ef9b636e
  Zhuohan Li authored Jan 19, 2024
  
  ef9b636e
- Support OpenAI API server in `benchmark_serving.py` (#2172) · 2709c000
  Harry Mellor authored Jan 19, 2024
  
  2709c000
- refactor complemention api for readability (#2499) · dd7e8f5f
  Simon Mo authored Jan 18, 2024
  
  dd7e8f5f
18 Jan, 2024 7 commits
- [BugFix] Fix abort_seq_group (#2463) · d2a68364
  ljss authored Jan 19, 2024
  
  d2a68364
- Don't download both safetensor and bin files. (#2480) · 7e108113
  Nikola Borisov authored Jan 18, 2024
  
  7e108113
- [Neuron] Add an option to build with neuron (#2065) · 18473cf4
  Liangfu Chen authored Jan 18, 2024
  
  18473cf4
- fix: fix some args desc (#2487) · 4df417d0
  zspo authored Jan 19, 2024
  
  4df417d0
- Minor fix in prefill cache example (#2494) · 5d80a917
  Jason Zhu authored Jan 18, 2024
  
  5d80a917
- fix stablelm.py tensor-parallel-size bug (#2482) · 8a25d3a7
  YingchaoX authored Jan 19, 2024
  
  8a25d3a7
- [Experimental] Prefix Caching Support (#1669) · d10f8e1d
  shiyi.c_98 authored Jan 17, 2024
```
Co-authored-by: DouHappy <2278958187@qq.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d10f8e1d
17 Jan, 2024 2 commits
- OpenAI Server refactoring (#2360) · 14cc317b
  FlorianJoncour authored Jan 17, 2024
  
  14cc317b
- Add StableLM3B model (#2372) · e1957c6e
  Hyunsung Lee authored Jan 17, 2024
  
  e1957c6e
16 Jan, 2024 2 commits
- ci: retry on build failure as well (#2457) · 8cd5a992
  Simon Mo authored Jan 16, 2024
  
  8cd5a992
- CI: make sure benchmark script exit on error (#2449) · 947f0b23
  Simon Mo authored Jan 16, 2024
  
  947f0b23
15 Jan, 2024 2 commits
- fix weigit loading for GQA with TP (#2379) · f780504d
  Chenhui Zhang authored Jan 16, 2024
  
  f780504d
- Allow buildkite to retry build on agent lost (#2446) · bfc072ad
  Simon Mo authored Jan 15, 2024
  
  bfc072ad