Commits · f645eb69545672d394e9e9e0ce46c725504fd2a0 · OpenDAS / vllm_cscc · GitLab

08 Jan, 2025 8 commits
- [Bugfix] Add checks for LoRA and CPU offload (#11810) · f645eb69
  Jee Jee Li authored Jan 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f645eb69
- [OpenVINO] Fixed Docker.openvino build (#11732) · f4923cb8
  Ilya Lavrenov authored Jan 08, 2025
```
Signed-off-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
```
  f4923cb8
- Fixed docker build for ppc64le (#11518) · b640b19c
  Nishidha authored Jan 08, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  b640b19c
- Remove the duplicate imports of MultiModalKwargs and PlaceholderRange… (#11824) · dc71af0a
  WangErXiao authored Jan 08, 2025
  
  dc71af0a
- [Misc] sort torch profiler table by kernel timing (#11813) · 4d29e91b
  Divakar Verma authored Jan 07, 2025
  
  4d29e91b
- [Bugfix] Fix image input for Pixtral-HF (#11741) · 91445c7b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91445c7b
- [Doc] Group examples into categories (#11782) · 5950f555
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5950f555
- [Bugfix] Significant performance drop on CPUs with --num-scheduler-steps > 1 (#11794) · a4e2b268
  Jie Fu (傅杰) authored Jan 08, 2025
  
  a4e2b268
07 Jan, 2025 19 commits
- [Doc]Add documentation for using EAGLE in vLLM (#11417) · 973f5dc5
  sroy745 authored Jan 07, 2025
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
```
  973f5dc5
- [Bugfix] update the prefix for qwen2 (#11795) · c994223d
  jiangjiadi authored Jan 08, 2025
```
Co-authored-by: jiadi.jjd <jiadi.jjd@antgroup.com>
```
  c994223d
- [optimization] remove python function call for custom op (#11750) · 869579a7
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  869579a7
- [Doc] Add note to `gte-Qwen2` models (#11808) · c0efe92d
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c0efe92d
- [doc] update how pip can install nightly wheels (#11806) · d9fa1c05
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d9fa1c05
- [V1] Support audio language models on V1 (#11733) · 2de197bd
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2de197bd
- [doc] add doc to explain how to use uv (#11773) · 869e829b
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  869e829b
- [Bugfix] Comprehensively test and fix LLaVA-NeXT feature size calculation (#11800) · 8f37be38
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f37be38
- [V1][Doc] Update V1 support for `LLaVa-NeXT-Video` (#11798) · 8082ad79
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  8082ad79
- [CI][CPU] adding build number to docker image name (#11788) · 1e4ce295
  Yuan authored Jan 07, 2025
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  1e4ce295
- [Doc] Create a vulnerability management team (#9925) · ce1917fc
  Russell Bryant authored Jan 07, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ce1917fc
- fix init error for MessageQueue when n_local_reader is zero (#11768) · e512f76a
  XiaobingZhang authored Jan 07, 2025
  
  e512f76a
- [CI] Fix neuron CI and run offline tests (#11779) · 898cdf03
  Liangfu Chen authored Jan 06, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  898cdf03
- [Bugfix] Update attention interface in `Whisper` (#11784) · 0f3f3c86
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0f3f3c86
- [Kernel][LoRA]Punica prefill kernels fusion (#11234) · b2785579
  Jee Jee Li authored Jan 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Zhonghua Deng <abatom@163.com>
```
  b2785579
- [Doc][3/N] Reorganize Serving section (#11766) · 8ceffbf3
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ceffbf3
- [XPU] Make pp group initilized for pipeline-parallelism (#11648) · d93d2d74
  YiSheng5 authored Jan 07, 2025
```
Signed-off-by: yisheng <yi.sheng@intel.com>
```
  d93d2d74
- [Model] Future-proof Qwen2-Audio multi-modal processor (#11776) · d0169e1b
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d0169e1b
- [Bugfix] Fix LLaVA-NeXT feature size precision error (for real) (#11772) · 08fb75c7
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  08fb75c7
06 Jan, 2025 13 commits
- [V1] Extend beyond image modality and support mixed-modality inference with... · 91b361ae
  Roger Wang authored Jan 06, 2025
```
[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91b361ae
- [Kernel] Move attn_type to Attention.__init__() (#11690) · e20c92bb
  Chen Zhang authored Jan 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e20c92bb
- [Bugfix][V1] Fix molmo text-only inputs (#11676) · 32c9eff2
  Jee Jee Li authored Jan 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  32c9eff2
- [doc] explain how to add interleaving sliding window support (#11771) · 4ca5d40a
  youkaichao authored Jan 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4ca5d40a
- [Bugfix] Fix max image size for LLaVA-Onevision (#11769) · 9279b9f8
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9279b9f8
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
- [VLM] Separate out profiling-related logic (#11746) · 996357e4
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  996357e4
- k8s-config: Update the secret to use stringData (#11679) · 2a622d70
  Suraj Deshmukh authored Jan 06, 2025
```
Signed-off-by: Suraj Deshmukh <surajd.service@gmail.com>
```
  2a622d70
- [mypy] Forward pass function type hints in lora (#11740) · 9c749713
  Lucas Tucker authored Jan 06, 2025
```
Signed-off-by: lucast2021 <lucast2021@headroyce.org>
Co-authored-by: lucast2021 <lucast2021@headroyce.org>
```
  9c749713
- [V1] Refactor get_executor_cls (#11754) · 022c5c69
  Rui Qiao authored Jan 05, 2025
  
  022c5c69
- [Misc] Fix typo for valid_tool_parses (#11753) · f8fcca10
  Rui Qiao authored Jan 05, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  f8fcca10
- [V1] Add BlockTable class (#11693) · 06bfb519
  Woosuk Kwon authored Jan 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  06bfb519
- [Bugfix] Remove block size constraint (#11723) · 408e5600
  Cody Yu authored Jan 05, 2025
  
  408e5600