Commits · 582f2c6be7459a781d844e94f7511c198d756f2a · OpenDAS / vllm_cscc · GitLab

16 Oct, 2025 5 commits
- [BUG] Allow runai_streamer_sharded in config check (#26958) · 582f2c6b
  ahao-anyscale authored Oct 15, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  582f2c6b
- [CI] Enable Blackwell Llama4 MoE tests (#26731) · f8a0acbd
  Michael Goin authored Oct 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f8a0acbd
- [ROCm][FEAT] Fuse DeepSeek shared experts into AITER fused_moe ops (#24097) · 13170343
  kliuae authored Oct 16, 2025
```
Signed-off-by: chenjun <junchen2@amd.com>
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: valarLip <103567126+valarLip@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  13170343
- [Bugfix] reasoning_parser parameter handling in run_batch.py (#26225) · 0ecc553e
  InChang Jeong authored Oct 16, 2025
```
Signed-off-by: inc-jeong <inc.jeong@navercorp.com>
Signed-off-by: InChang Jeong <inc.jeong@navercorp.com>
Co-authored-by: USER <user@AL02367916.local>
```
  0ecc553e
- [Qwen3-Next] Add tuned MoE config for Qwen3-Next FP8 on H100 tp2 (#26887) · f96bc364
  felixzhu555 authored Oct 15, 2025
```
Signed-off-by: Felix Zhu <felixzhu555@gmail.com>
```
  f96bc364
15 Oct, 2025 35 commits
- [ci] Adjusting AMD test composition 2025-10-14 (#26852) · 938c43ea
  Alexei-V-Ivanov-AMD authored Oct 15, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  938c43ea
- Move query quantization to attention layer for Flashinfer & Triton. (#26534) · 0a9ef0cf
  Adrian Abeyta authored Oct 15, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Adrian Abeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  0a9ef0cf
- [Bug] Temporally Disable `VLLM_ALLREDUCE_USE_SYMM_MEM` by Default (#26925) · e5b438a2
  Wentao Ye authored Oct 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e5b438a2
- support flashinfer_fp4 moe for 5090 gpu (#26669) · 0b99f5d3
  XiaobingZhang authored Oct 16, 2025
```
Signed-off-by: XiaobingSuper <xiaobingzhangupc@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  0b99f5d3
- Vectorize RMS norm variance using vectorize_read_with_alignment (#26234) · 1f491aa0
  Benji Beck authored Oct 15, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  1f491aa0
- [NVIDIA] Add support for cudnn fp4 gemm via flashinfer (#26107) · de92d916
  Kaixi Hou authored Oct 15, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  de92d916
- [Chore] Clean up CODEOWNERS (#26923) · a1063628
  Woosuk Kwon authored Oct 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  a1063628
- [ModelOpt] Remove NVFP4 MoE K%16==0 constraint (#26891) · d7963752
  XiaobingZhang authored Oct 16, 2025
```
Signed-off-by: XiaobingSuper <xiaobingzhangupc@gmail.com>
```
  d7963752
- [Feature]: Use pydantic validation in observability.py config (#26637) · 14f84563
  Sam/Samuel authored Oct 16, 2025
```
Signed-off-by: Samuel Wu <cernunnos1710@gmail.com>
Signed-off-by: Sam/Samuel <57896620+cern1710@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  14f84563
- Olmo 3 tool parser and tests (#26143) · 4794c2bd
  Pradeep Dasigi authored Oct 15, 2025
```
Signed-off-by: Pradeep Dasigi <pradeepd@allenai.org>
```
  4794c2bd
- Lower sevarity of log when model info cache misses due to exception (#26917) · d3cbaa08
  Harry Mellor authored Oct 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d3cbaa08
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
- [Chore] Separate out `vllm.utils.func` (#26904) · 136a17fe
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  136a17fe
- [BugFix] Patch inductor memory plan logic (#26878) · f5743833
  Boyuan Feng authored Oct 15, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f5743833
- chore: remove unused marker (#26890) · 5d598680
  Max Wittig authored Oct 15, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
```
  5d598680
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c
- [Misc] Remove `isort` and `yapf` ignores (#26888) · f93e3480
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f93e3480
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
- [Lora]Load tuned multi-lora kernel configs from json files (#26319) · d4d1a602
  li2haipeng authored Oct 15, 2025
```
Signed-off-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>
Signed-off-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d4d1a602
- [Platform] allow platform to init dp group (#22243) · db1764e4
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  db1764e4
- [Easy] Get rid of unnecessary paraenthesis in kv_cache_manager (#26842) · 7f83b4ee
  Jialin Ouyang authored Oct 15, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  7f83b4ee
- [Fix] Remove divisibility requirement between num_kv_heads and tp_size in bailing_moe (#26876) · 5c3bae1a
  ant-yy authored Oct 15, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
```
  5c3bae1a
- [Misc] Update TritonLanguagePlaceholder to have attributes that are used by... · 5210dc39
  Xudong Ma authored Oct 15, 2025
```
[Misc] Update TritonLanguagePlaceholder to have attributes that are used by Flash Linear Attention ops. (#26853)
Co-authored-by: Xudong Ma <mxd@meta.com>
```
  5210dc39
- [doc] add Context Parallel Deployment doc (#26877) · 650b51f9
  youkaichao authored Oct 15, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  650b51f9
- [Doc] ruff format remaining Python examples (#26795) · 62566979
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  62566979
- [CI] Fix mypy for `vllm/executor` (#26845) · 71557a5f
  Wentao Ye authored Oct 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  71557a5f
- [CI/Build] Add Qwen2.5-VL-7B-Instruct ChartQA Accuracy Tests in CI (#21810) · f3c378ff
  Zhewen Li authored Oct 15, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: zhewenli <zhewenli@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Ye (Charlotte) Qi <ye.charlotte.qi@gmail.com>
```
  f3c378ff
- [Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (#26456) · f5ed68ef
  Yongye Zhu authored Oct 15, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  f5ed68ef
- [bugfix] Lazy import cv2 (#26869) · efdef57b
  Angela Yi authored Oct 15, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  efdef57b
- [Misc] Use helper function to generate dummy messages in OpenAI MM tests (#26875) · b8a45721
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b8a45721
- [DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656) · 302ef403
  Mengqing Cao authored Oct 15, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  302ef403
- [Bugfix][Multi Modal] Fix incorrect Molmo token processing (#26873) · 8865da15
  sangho.lee authored Oct 15, 2025
```
Signed-off-by: sanghol <sanghol@allenai.org>
```
  8865da15
- [Graph Partition] pass tests for decorator (#26831) · f0862eae
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  f0862eae
- [Bugfix] Fix qwen3-omni audio truncation issue (#26815) · 8c851f6d
  Isotr0py authored Oct 15, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8c851f6d
- [BugFix] Patch inductor partitioning logic (#26735) · 7cfa420f
  Angela Yi authored Oct 14, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  7cfa420f