Commits · 51679bbda84df6e68d4cef8f59abf8f962bf59e0 · norm / vllm

28 Jan, 2024 1 commit
- Speed up Punica compilation (#2632) · f8ecb84c
  Woosuk Kwon authored Jan 27, 2024
  
  f8ecb84c
23 Jan, 2024 1 commit

[Experimental] Add multi-LoRA support (#1804) · 9b945daa

Antoni Baum authored Jan 24, 2024


Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

9b945daa

20 Jan, 2024 1 commit
- Add benchmark serving to CI (#2505) · 00efdc84
  Simon Mo authored Jan 19, 2024
  
  00efdc84
18 Jan, 2024 1 commit

[Experimental] Prefix Caching Support (#1669) · d10f8e1d

shiyi.c_98 authored Jan 17, 2024


Co-authored-by: DouHappy <2278958187@qq.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

d10f8e1d

17 Jan, 2024 1 commit
- OpenAI Server refactoring (#2360) · 14cc317b
  FlorianJoncour authored Jan 17, 2024
  
  14cc317b
16 Jan, 2024 2 commits
- ci: retry on build failure as well (#2457) · 8cd5a992
  Simon Mo authored Jan 16, 2024
  
  8cd5a992
- CI: make sure benchmark script exit on error (#2449) · 947f0b23
  Simon Mo authored Jan 16, 2024
  
  947f0b23
15 Jan, 2024 1 commit
- Allow buildkite to retry build on agent lost (#2446) · bfc072ad
  Simon Mo authored Jan 15, 2024
  
  bfc072ad
14 Jan, 2024 1 commit
- [CI] Add Buildkite (#2355) · 6e01e8c1
  Simon Mo authored Jan 14, 2024
  
  6e01e8c1