Commits · 5950f555a1d2ce19c30efb24abe03737320d05c1 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "77a318bd01adc7881cd73582beae074be47f76d5"

08 Jan, 2025 1 commit
- [Bugfix] Significant performance drop on CPUs with --num-scheduler-steps > 1 (#11794) · a4e2b268
  Jie Fu (傅杰) authored Jan 08, 2025
  
  a4e2b268
07 Jan, 2025 10 commits
- [Bugfix] update the prefix for qwen2 (#11795) · c994223d
  jiangjiadi authored Jan 08, 2025
```
Co-authored-by: jiadi.jjd <jiadi.jjd@antgroup.com>
```
  c994223d
- [optimization] remove python function call for custom op (#11750) · 869579a7
  youkaichao authored Jan 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  869579a7
- [V1] Support audio language models on V1 (#11733) · 2de197bd
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2de197bd
- [Bugfix] Comprehensively test and fix LLaVA-NeXT feature size calculation (#11800) · 8f37be38
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f37be38
- fix init error for MessageQueue when n_local_reader is zero (#11768) · e512f76a
  XiaobingZhang authored Jan 07, 2025
  
  e512f76a
- [Bugfix] Update attention interface in `Whisper` (#11784) · 0f3f3c86
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0f3f3c86
- [Kernel][LoRA]Punica prefill kernels fusion (#11234) · b2785579
  Jee Jee Li authored Jan 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Zhonghua Deng <abatom@163.com>
```
  b2785579
- [XPU] Make pp group initilized for pipeline-parallelism (#11648) · d93d2d74
  YiSheng5 authored Jan 07, 2025
```
Signed-off-by: yisheng <yi.sheng@intel.com>
```
  d93d2d74
- [Model] Future-proof Qwen2-Audio multi-modal processor (#11776) · d0169e1b
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d0169e1b
- [Bugfix] Fix LLaVA-NeXT feature size precision error (for real) (#11772) · 08fb75c7
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  08fb75c7
06 Jan, 2025 13 commits
- [V1] Extend beyond image modality and support mixed-modality inference with... · 91b361ae
  Roger Wang authored Jan 06, 2025
```
[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91b361ae
- [Kernel] Move attn_type to Attention.__init__() (#11690) · e20c92bb
  Chen Zhang authored Jan 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e20c92bb
- [Bugfix][V1] Fix molmo text-only inputs (#11676) · 32c9eff2
  Jee Jee Li authored Jan 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  32c9eff2
- [Bugfix] Fix max image size for LLaVA-Onevision (#11769) · 9279b9f8
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9279b9f8
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
- [VLM] Separate out profiling-related logic (#11746) · 996357e4
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  996357e4
- [mypy] Forward pass function type hints in lora (#11740) · 9c749713
  Lucas Tucker authored Jan 06, 2025
```
Signed-off-by: lucast2021 <lucast2021@headroyce.org>
Co-authored-by: lucast2021 <lucast2021@headroyce.org>
```
  9c749713
- [V1] Refactor get_executor_cls (#11754) · 022c5c69
  Rui Qiao authored Jan 05, 2025
  
  022c5c69
- [Misc] Fix typo for valid_tool_parses (#11753) · f8fcca10
  Rui Qiao authored Jan 05, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  f8fcca10
- [V1] Add BlockTable class (#11693) · 06bfb519
  Woosuk Kwon authored Jan 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  06bfb519
- [Bugfix] Remove block size constraint (#11723) · 408e5600
  Cody Yu authored Jan 05, 2025
  
  408e5600
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
- [distributed] remove pynccl's redundant change_state (#11749) · 9e764e7b
  cennn authored Jan 06, 2025
  
  9e764e7b
05 Jan, 2025 3 commits
- [Frontend] Improve `StreamingResponse` Exception Handling (#11752) · 33fc1e2e
  Robert Shaw authored Jan 05, 2025
  
  33fc1e2e
- fix: [doc] fix typo (#11751) · eba17173
  Lancer authored Jan 06, 2025
```
Co-authored-by: Lancer <maruixiang6688@gmail.com>
```
  eba17173
- [distributed] remove pynccl's redundant stream (#11744) · 635b8972
  cennn authored Jan 05, 2025
  
  635b8972
04 Jan, 2025 6 commits
- [Model] Remove unnecessary weight initialization logic (#11736) · 65c08928
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  65c08928
- [Bugfix] Fix precision error in LLaVA-NeXT (#11735) · ba214dff
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba214dff
- [VLM] Merged multi-modal processors for LLaVA-NeXT-Video and LLaVA-OneVision (#11717) · eed11ebe
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eed11ebe
- [Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture (#11233) · 300acb83
  Yan Burman authored Jan 04, 2025
```
Signed-off-by: Yan Burman <yanburman@users.noreply.github.com>
Signed-off-by: Ido Asraff <idoa@atero.ai>
```
  300acb83
- [V1] Add `RayExecutor` support for `AsyncLLM` (api server) (#11712) · fbf25645
  Kunshang Ji authored Jan 04, 2025
  
  fbf25645
- [V1] log GPU blocks num for MultiprocExecutor (#11656) · e5d7ed0c
  WangErXiao authored Jan 04, 2025
  
  e5d7ed0c
03 Jan, 2025 7 commits
- [V1] Chore: cruft removal (#11724) · ad0d567e
  Robert Shaw authored Jan 03, 2025
  
  ad0d567e
- Update requirements-tpu.txt to support python 3.9 and 3.11 (#11695) · bf0d97d7
  Michael Goin authored Jan 03, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  bf0d97d7
- [Misc]Add BNB quantization for Qwen2VL (#11719) · a655eb30
  Jee Jee Li authored Jan 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  a655eb30
- [V1] Improve TP>1 Error Handling + Stack Trace (#11721) · 1543914c
  Robert Shaw authored Jan 03, 2025
```
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  1543914c
- [Bugfix] Fix ColumnParallelLinearWithLoRA slice (#11708) · 61fed92c
  ZincCat authored Jan 03, 2025
```
Signed-off-by: ZincCat <zincchloride@outlook.com>
```
  61fed92c
- [V1] Simplify Shutdown (#11659) · 80c751e7
  Robert Shaw authored Jan 03, 2025
  
  80c751e7
- [Model] Whisper model implementation (#11280) · e1a5c2f0
  Aurick Qiao authored Jan 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  e1a5c2f0