Commits · acaa2c0a4a53dbb57f85f1042b1a6f1e3f24cef5 · OpenDAS / vllm_cscc · GitLab

14 Oct, 2025 40 commits
- [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964) · acaa2c0a
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  acaa2c0a
- [Attention][Spec Decode] FlashMLA spec decode support (#26541) · 82af928c
  Matthew Bonanni authored Oct 14, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  82af928c
- llama4_vision_rope: add HIP override to accept (q, k) and avoid (positions, q, k) mismatch (#26790) · 87efc681
  Huamin Li authored Oct 14, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  87efc681
- [CI Failure] Fix tests with missing TinyLlama-1.1B-Chat-v1.0-FP8-e2e (#26816) · c3a722fc
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c3a722fc
- [Kernel][MoE] Add MoE tunings for GLM 4.6-FP8 and GLM 4.5 Air on NVidia B200 (#26818) · aba48f7d
  Ze'ev Klapow authored Oct 14, 2025
  
  aba48f7d
- [CI] Raise VLLM_MAX_SIZE_MB to 500 due to failing Build wheel - CUDA 12.9 (#26722) · 04b5f980
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  04b5f980
- Update coveragerc and add codecov.yml for path fixes (#26435) · efc8f7d8
  Reza Barazesh authored Oct 14, 2025
```
Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
```
  efc8f7d8
- [Config] Remove Unused Environment Variable `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` (#26743) · 6d87a283
  Wentao Ye authored Oct 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6d87a283
- Revert "[issues template] Encourage the author implement their own ideas" (#26814) · e6cdbd67
  wang.yuqi authored Oct 14, 2025
  
  e6cdbd67
- [Feature][Responses API] Stream Function Call - harmony (#24317) · df850c49
  Chauncey authored Oct 14, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  df850c49
- [KVConnector][Metrics] Aggregate scheduler-side KVConnectorStats (#26046) · 720394de
  Qier Li authored Oct 14, 2025
```
Signed-off-by: Qier Li <kevin44036@gmail.com>
```
  720394de
- [issues template] Encourage the author implement their own ideas (#26671) · 88a49745
  wang.yuqi authored Oct 14, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  88a49745
- use combo kernel to fuse qk-norm and qk-rope (#26682) · ca683a2a
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ca683a2a
- Adjusted the model order of the model registration file (#26798) · e9f1b8c9
  汪志鹏 authored Oct 14, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  e9f1b8c9
- [DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d
  Jaya Yuan authored Oct 14, 2025
```
Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>
```
  ea97940d
- [CI/Build] Cleanup LoRA test (#26752) · fdd32750
  Jee Jee Li authored Oct 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdd32750
- [Feature] Change vllm.py with pydantic validation (#26726) · c715ba37
  Vladislav Bronzov authored Oct 14, 2025
```
Signed-off-by: Vladislav <vladislav.bronzov@gmail.com>
Signed-off-by: Vladislav Bronzov <58587565+VladOS95-cyber@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c715ba37
- [Chore] Remove `SupportsV0Only` interface and update supported models docs (#26783) · 9c4cb683
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9c4cb683
- [CI] Fix test_tool_id_kimi_k2 (#26787) · 780eb03d
  Chauncey authored Oct 14, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  780eb03d
- [Doc] ruff format some Python examples (#26767) · ef9676a1
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef9676a1
- Don't allow `typos` to fix by default (#26785) · 70b1b330
  Harry Mellor authored Oct 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  70b1b330
- [Chore] Use `max_transformers_version` for Qwen-VL test (#26792) · d1d063a5
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d1d063a5
- [NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) · 7e6edb14
  Chendi.Xue authored Oct 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  7e6edb14
- [Model] Use merge_by_field_config for MM models (O-P) (#26776) · 74704d45
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  74704d45
- [Bugfix] Standardize merging multimodal embeddings (#26771) · d2f816d6
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f816d6
- [Plugin] Make plugin group clear (#26757) · 577d4982
  wangxiyuan authored Oct 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  577d4982
- [Bugfix][FE]: Always include usage with `--enable-force-include-usage ` (#20983) · fd85c9f4
  Max Wittig authored Oct 14, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
Signed-off-by: Antoine Auger <antoineauger@users.noreply.github.com>
Co-authored-by: Antoine Auger <antoineauger@users.noreply.github.com>
```
  fd85c9f4
- [CI/Build] Use 127.0.0.1 instead of localhost in utils (#26750) · d32c611f
  Ye (Charlotte) Qi authored Oct 14, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  d32c611f
- [Model][Bugfix]fix ernie45 load failed due to ernie45 eplb code (#26684) · 01ad27fa
  CSWYF3634076 authored Oct 14, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  01ad27fa
- scheduler.py: Update the name of the default scheduler. (#26758) · 481545b3
  Ryan Li authored Oct 14, 2025
```
Signed-off-by: Ryan Li <ryanli@ryanli.org>
```
  481545b3
- [ci] Adding the test-amd.yaml for test definitions for the AMD backend. (alternative PR) (#26718) · d3cc8427
  Alexei-V-Ivanov-AMD authored Oct 14, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  d3cc8427
- [CI] [ROCm] Automate CC list for ROCm related issue (#26753) · 4821ac1b
  vllmellm authored Oct 14, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  4821ac1b
- Fix lora tests failure in TPU CI due to the removal of LoRA bias (#26723) · 4497c8f8
  XiongfeiWei authored Oct 13, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  4497c8f8
- [Docs] Add a start tag to build.inc.md (#26747) · 2e36cdbe
  Michael Yao authored Oct 14, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  2e36cdbe
- Add support for the /rerank endpoint in vllm bench serve (#26602) · fe3edb4c
  Maximilien de Bayser authored Oct 14, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  fe3edb4c
- [Feature][Quantization] auto_round format add support for regex (#24024) · 29350922
  Heng Guo authored Oct 14, 2025
```
Signed-off-by: n1ck-guo <heng.guo@intel.com>
Signed-off-by: Heng Guo <heng.guo@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  29350922
- [torch.compile] Unwrap fused_marlin_moe custom op (#26739) · 8ae16928
  Varun Sundar Rabindranath authored Oct 13, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  8ae16928
- [build][torch.compile] upgrade depyf version (#26702) · 8a0af6a5
  youkaichao authored Oct 14, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8a0af6a5
- [Easy] Fix env type check errors from VLLM_DEBUG_LOG_API_SERVER_RESPONSE (#26742) · cfded807
  Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  cfded807
- [compile] Enable sequence parallelism for full cuda graph without specifying compile sizes (#26681) · b59dd19b
  Angela Yi authored Oct 13, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  b59dd19b