Commits · 8f37be38ebfe0295a4925837c501c87149997a4d · OpenDAS / vllm_cscc · GitLab

07 Jan, 2025 12 commits
- [Bugfix] Comprehensively test and fix LLaVA-NeXT feature size calculation (#11800) · 8f37be38
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f37be38
- [V1][Doc] Update V1 support for `LLaVa-NeXT-Video` (#11798) · 8082ad79
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  8082ad79
- [CI][CPU] adding build number to docker image name (#11788) · 1e4ce295
  Yuan authored Jan 07, 2025
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  1e4ce295
- [Doc] Create a vulnerability management team (#9925) · ce1917fc
  Russell Bryant authored Jan 07, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ce1917fc
- fix init error for MessageQueue when n_local_reader is zero (#11768) · e512f76a
  XiaobingZhang authored Jan 07, 2025
  
  e512f76a
- [CI] Fix neuron CI and run offline tests (#11779) · 898cdf03
  Liangfu Chen authored Jan 06, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  898cdf03
- [Bugfix] Update attention interface in `Whisper` (#11784) · 0f3f3c86
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0f3f3c86
- [Kernel][LoRA]Punica prefill kernels fusion (#11234) · b2785579
  Jee Jee Li authored Jan 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Zhonghua Deng <abatom@163.com>
```
  b2785579
- [Doc][3/N] Reorganize Serving section (#11766) · 8ceffbf3
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ceffbf3
- [XPU] Make pp group initilized for pipeline-parallelism (#11648) · d93d2d74
  YiSheng5 authored Jan 07, 2025
```
Signed-off-by: yisheng <yi.sheng@intel.com>
```
  d93d2d74
- [Model] Future-proof Qwen2-Audio multi-modal processor (#11776) · d0169e1b
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d0169e1b
- [Bugfix] Fix LLaVA-NeXT feature size precision error (for real) (#11772) · 08fb75c7
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  08fb75c7
06 Jan, 2025 15 commits
- [V1] Extend beyond image modality and support mixed-modality inference with... · 91b361ae
  Roger Wang authored Jan 06, 2025
```
[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91b361ae
- [Kernel] Move attn_type to Attention.__init__() (#11690) · e20c92bb
  Chen Zhang authored Jan 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e20c92bb
- [Bugfix][V1] Fix molmo text-only inputs (#11676) · 32c9eff2
  Jee Jee Li authored Jan 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  32c9eff2
- [doc] explain how to add interleaving sliding window support (#11771) · 4ca5d40a
  youkaichao authored Jan 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4ca5d40a
- [Bugfix] Fix max image size for LLaVA-Onevision (#11769) · 9279b9f8
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9279b9f8
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
- [VLM] Separate out profiling-related logic (#11746) · 996357e4
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  996357e4
- k8s-config: Update the secret to use stringData (#11679) · 2a622d70
  Suraj Deshmukh authored Jan 06, 2025
```
Signed-off-by: Suraj Deshmukh <surajd.service@gmail.com>
```
  2a622d70
- [mypy] Forward pass function type hints in lora (#11740) · 9c749713
  Lucas Tucker authored Jan 06, 2025
```
Signed-off-by: lucast2021 <lucast2021@headroyce.org>
Co-authored-by: lucast2021 <lucast2021@headroyce.org>
```
  9c749713
- [V1] Refactor get_executor_cls (#11754) · 022c5c69
  Rui Qiao authored Jan 05, 2025
  
  022c5c69
- [Misc] Fix typo for valid_tool_parses (#11753) · f8fcca10
  Rui Qiao authored Jan 05, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  f8fcca10
- [V1] Add BlockTable class (#11693) · 06bfb519
  Woosuk Kwon authored Jan 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  06bfb519
- [Bugfix] Remove block size constraint (#11723) · 408e5600
  Cody Yu authored Jan 05, 2025
  
  408e5600
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
- [distributed] remove pynccl's redundant change_state (#11749) · 9e764e7b
  cennn authored Jan 06, 2025
  
  9e764e7b
05 Jan, 2025 4 commits
- [Frontend] Improve `StreamingResponse` Exception Handling (#11752) · 33fc1e2e
  Robert Shaw authored Jan 05, 2025
  
  33fc1e2e
- fix: [doc] fix typo (#11751) · eba17173
  Lancer authored Jan 06, 2025
```
Co-authored-by: Lancer <maruixiang6688@gmail.com>
```
  eba17173
- [distributed] remove pynccl's redundant stream (#11744) · 635b8972
  cennn authored Jan 05, 2025
  
  635b8972
- [MISC] Replace c10::optional with std::optional (#11730) · 4068f4b5
  Lu Fang authored Jan 04, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  4068f4b5
04 Jan, 2025 9 commits
- [Bugfix][V1] Fix test_kv_cache_utils.py (#11738) · 47831430
  Jee Jee Li authored Jan 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  47831430
- [Model] Remove unnecessary weight initialization logic (#11736) · 65c08928
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  65c08928
- [Bugfix] Fix precision error in LLaVA-NeXT (#11735) · ba214dff
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba214dff
- [VLM] Merged multi-modal processors for LLaVA-NeXT-Video and LLaVA-OneVision (#11717) · eed11ebe
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eed11ebe
- [Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture (#11233) · 300acb83
  Yan Burman authored Jan 04, 2025
```
Signed-off-by: Yan Burman <yanburman@users.noreply.github.com>
Signed-off-by: Ido Asraff <idoa@atero.ai>
```
  300acb83
- [V1] Add kv cache utils tests. (#11513) · d91457d5
  xcnick authored Jan 04, 2025
```
Signed-off-by: xcnick <xcnick0412@gmail.com>
```
  d91457d5
- [V1] Add `RayExecutor` support for `AsyncLLM` (api server) (#11712) · fbf25645
  Kunshang Ji authored Jan 04, 2025
  
  fbf25645
- Update bnb.md with example for OpenAI (#11718) · d1d49397
  Alberto Ferrer authored Jan 04, 2025
  
  d1d49397
- Update tool_calling.md (#11701) · 9c93636d
  Hust_YangXian authored Jan 04, 2025
  
  9c93636d