Commits · df850c4912d30d583682b7fc4d872aa5fd90bced · OpenDAS / vllm_cscc

14 Oct, 2025 33 commits
- [Feature][Responses API] Stream Function Call - harmony (#24317) · df850c49
  Chauncey authored Oct 14, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  df850c49
- [KVConnector][Metrics] Aggregate scheduler-side KVConnectorStats (#26046) · 720394de
  Qier Li authored Oct 14, 2025
```
Signed-off-by: Qier Li <kevin44036@gmail.com>
```
  720394de
- [issues template] Encourage the author implement their own ideas (#26671) · 88a49745
  wang.yuqi authored Oct 14, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  88a49745
- use combo kernel to fuse qk-norm and qk-rope (#26682) · ca683a2a
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ca683a2a
- Adjusted the model order of the model registration file (#26798) · e9f1b8c9
  汪志鹏 authored Oct 14, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  e9f1b8c9
- [DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d
  Jaya Yuan authored Oct 14, 2025
```
Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>
```
  ea97940d
- [CI/Build] Cleanup LoRA test (#26752) · fdd32750
  Jee Jee Li authored Oct 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdd32750
- [Feature] Change vllm.py with pydantic validation (#26726) · c715ba37
  Vladislav Bronzov authored Oct 14, 2025
```
Signed-off-by: Vladislav <vladislav.bronzov@gmail.com>
Signed-off-by: Vladislav Bronzov <58587565+VladOS95-cyber@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c715ba37
- [Chore] Remove `SupportsV0Only` interface and update supported models docs (#26783) · 9c4cb683
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9c4cb683
- [CI] Fix test_tool_id_kimi_k2 (#26787) · 780eb03d
  Chauncey authored Oct 14, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  780eb03d
- [Doc] ruff format some Python examples (#26767) · ef9676a1
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef9676a1
- Don't allow `typos` to fix by default (#26785) · 70b1b330
  Harry Mellor authored Oct 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  70b1b330
- [Chore] Use `max_transformers_version` for Qwen-VL test (#26792) · d1d063a5
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d1d063a5
- [NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) · 7e6edb14
  Chendi.Xue authored Oct 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  7e6edb14
- [Model] Use merge_by_field_config for MM models (O-P) (#26776) · 74704d45
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  74704d45
- [Bugfix] Standardize merging multimodal embeddings (#26771) · d2f816d6
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f816d6
- [Plugin] Make plugin group clear (#26757) · 577d4982
  wangxiyuan authored Oct 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  577d4982
- [Bugfix][FE]: Always include usage with `--enable-force-include-usage ` (#20983) · fd85c9f4
  Max Wittig authored Oct 14, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
Signed-off-by: Antoine Auger <antoineauger@users.noreply.github.com>
Co-authored-by: Antoine Auger <antoineauger@users.noreply.github.com>
```
  fd85c9f4
- [CI/Build] Use 127.0.0.1 instead of localhost in utils (#26750) · d32c611f
  Ye (Charlotte) Qi authored Oct 14, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  d32c611f
- [Model][Bugfix]fix ernie45 load failed due to ernie45 eplb code (#26684) · 01ad27fa
  CSWYF3634076 authored Oct 14, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  01ad27fa
- scheduler.py: Update the name of the default scheduler. (#26758) · 481545b3
  Ryan Li authored Oct 14, 2025
```
Signed-off-by: Ryan Li <ryanli@ryanli.org>
```
  481545b3
- [ci] Adding the test-amd.yaml for test definitions for the AMD backend. (alternative PR) (#26718) · d3cc8427
  Alexei-V-Ivanov-AMD authored Oct 14, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  d3cc8427
- [CI] [ROCm] Automate CC list for ROCm related issue (#26753) · 4821ac1b
  vllmellm authored Oct 14, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  4821ac1b
- Fix lora tests failure in TPU CI due to the removal of LoRA bias (#26723) · 4497c8f8
  XiongfeiWei authored Oct 13, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  4497c8f8
- [Docs] Add a start tag to build.inc.md (#26747) · 2e36cdbe
  Michael Yao authored Oct 14, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  2e36cdbe
- Add support for the /rerank endpoint in vllm bench serve (#26602) · fe3edb4c
  Maximilien de Bayser authored Oct 14, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  fe3edb4c
- [Feature][Quantization] auto_round format add support for regex (#24024) · 29350922
  Heng Guo authored Oct 14, 2025
```
Signed-off-by: n1ck-guo <heng.guo@intel.com>
Signed-off-by: Heng Guo <heng.guo@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  29350922
- [torch.compile] Unwrap fused_marlin_moe custom op (#26739) · 8ae16928
  Varun Sundar Rabindranath authored Oct 13, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  8ae16928
- [build][torch.compile] upgrade depyf version (#26702) · 8a0af6a5
  youkaichao authored Oct 14, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8a0af6a5
- [Easy] Fix env type check errors from VLLM_DEBUG_LOG_API_SERVER_RESPONSE (#26742) · cfded807
  Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  cfded807
- [compile] Enable sequence parallelism for full cuda graph without specifying compile sizes (#26681) · b59dd19b
  Angela Yi authored Oct 13, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  b59dd19b
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
13 Oct, 2025 7 commits

Add tests for chunked prefill and prefix cache with causal pooling models (#26526) · d8bebb00
Maximilien de Bayser authored Oct 13, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Ayush Singh <ayush1009208@gmail.com>
```
d8bebb00
[ResponseAPI] Further polish message serialization and unit tests (#26728) · 35bc22f2
Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
35bc22f2
Pruning kernel Core Tests (#26727) · fa96fb9c
Fardin Hoque authored Oct 13, 2025
```
Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
```
fa96fb9c

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and... · 7200a21c

Wentao Ye authored Oct 13, 2025


[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and Unsupported type' (#26532)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

7200a21c

[CI Perf]Prune Tests in kernel/mamba (#26538) · 577c72a2

Fardin Hoque authored Oct 13, 2025

Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

577c72a2

[CI] Fix mypy for `vllm/distributed` (#26593) · 314285d4

Wentao Ye authored Oct 13, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

314285d4