Commits · 4aed506b6538ec4f284c480bf4449e9dc5f72054 · OpenDAS / vllm_cscc · GitLab

14 Oct, 2025 40 commits
- [Core] Streamline some structured output related code (#26737) · 4aed506b
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4aed506b
- remove attn output view kernel (#26680) · a86b4c58
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a86b4c58
- [Minor] Group async_scheduling related fields in model runner init (#26736) · ff4810ba
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ff4810ba
- fix: response_format for completion (#23212) · 9d696492
  Nan Qin authored Oct 14, 2025
```
Signed-off-by: Nan2018 <qinnanjoshua@gmail.com>
```
  9d696492
- Added MoE configs for llama 4, H200 device with tp=4/8 tuning (#26837) · 0e658189
  Dhruvil Bhatt authored Oct 14, 2025
```
Signed-off-by: Dhruvil Bhatt <bhattdbh@amazon.com>
```
  0e658189
- [Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146) · 380f1752
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  380f1752
- Notice for deprecation of AutoAWQ (#26820) · b92ab3de
  HDCharles authored Oct 14, 2025
```
Signed-off-by: HDCharles <39544797+HDCharles@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b92ab3de
- [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964) · acaa2c0a
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  acaa2c0a
- [Attention][Spec Decode] FlashMLA spec decode support (#26541) · 82af928c
  Matthew Bonanni authored Oct 14, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  82af928c
- llama4_vision_rope: add HIP override to accept (q, k) and avoid (positions, q, k) mismatch (#26790) · 87efc681
  Huamin Li authored Oct 14, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  87efc681
- [CI Failure] Fix tests with missing TinyLlama-1.1B-Chat-v1.0-FP8-e2e (#26816) · c3a722fc
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c3a722fc
- [Kernel][MoE] Add MoE tunings for GLM 4.6-FP8 and GLM 4.5 Air on NVidia B200 (#26818) · aba48f7d
  Ze'ev Klapow authored Oct 14, 2025
  
  aba48f7d
- [CI] Raise VLLM_MAX_SIZE_MB to 500 due to failing Build wheel - CUDA 12.9 (#26722) · 04b5f980
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  04b5f980
- Update coveragerc and add codecov.yml for path fixes (#26435) · efc8f7d8
  Reza Barazesh authored Oct 14, 2025
```
Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
```
  efc8f7d8
- [Config] Remove Unused Environment Variable `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` (#26743) · 6d87a283
  Wentao Ye authored Oct 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6d87a283
- Revert "[issues template] Encourage the author implement their own ideas" (#26814) · e6cdbd67
  wang.yuqi authored Oct 14, 2025
  
  e6cdbd67
- [Feature][Responses API] Stream Function Call - harmony (#24317) · df850c49
  Chauncey authored Oct 14, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  df850c49
- [KVConnector][Metrics] Aggregate scheduler-side KVConnectorStats (#26046) · 720394de
  Qier Li authored Oct 14, 2025
```
Signed-off-by: Qier Li <kevin44036@gmail.com>
```
  720394de
- [issues template] Encourage the author implement their own ideas (#26671) · 88a49745
  wang.yuqi authored Oct 14, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  88a49745
- use combo kernel to fuse qk-norm and qk-rope (#26682) · ca683a2a
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ca683a2a
- Adjusted the model order of the model registration file (#26798) · e9f1b8c9
  汪志鹏 authored Oct 14, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  e9f1b8c9
- [DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d
  Jaya Yuan authored Oct 14, 2025
```
Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>
```
  ea97940d
- [CI/Build] Cleanup LoRA test (#26752) · fdd32750
  Jee Jee Li authored Oct 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdd32750
- [Feature] Change vllm.py with pydantic validation (#26726) · c715ba37
  Vladislav Bronzov authored Oct 14, 2025
```
Signed-off-by: Vladislav <vladislav.bronzov@gmail.com>
Signed-off-by: Vladislav Bronzov <58587565+VladOS95-cyber@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c715ba37
- [Chore] Remove `SupportsV0Only` interface and update supported models docs (#26783) · 9c4cb683
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9c4cb683
- [CI] Fix test_tool_id_kimi_k2 (#26787) · 780eb03d
  Chauncey authored Oct 14, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  780eb03d
- [Doc] ruff format some Python examples (#26767) · ef9676a1
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef9676a1
- Don't allow `typos` to fix by default (#26785) · 70b1b330
  Harry Mellor authored Oct 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  70b1b330
- [Chore] Use `max_transformers_version` for Qwen-VL test (#26792) · d1d063a5
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d1d063a5
- [NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) · 7e6edb14
  Chendi.Xue authored Oct 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  7e6edb14
- [Model] Use merge_by_field_config for MM models (O-P) (#26776) · 74704d45
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  74704d45
- [Bugfix] Standardize merging multimodal embeddings (#26771) · d2f816d6
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f816d6
- [Plugin] Make plugin group clear (#26757) · 577d4982
  wangxiyuan authored Oct 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  577d4982
- [Bugfix][FE]: Always include usage with `--enable-force-include-usage ` (#20983) · fd85c9f4
  Max Wittig authored Oct 14, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
Signed-off-by: Antoine Auger <antoineauger@users.noreply.github.com>
Co-authored-by: Antoine Auger <antoineauger@users.noreply.github.com>
```
  fd85c9f4
- [CI/Build] Use 127.0.0.1 instead of localhost in utils (#26750) · d32c611f
  Ye (Charlotte) Qi authored Oct 14, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  d32c611f
- [Model][Bugfix]fix ernie45 load failed due to ernie45 eplb code (#26684) · 01ad27fa
  CSWYF3634076 authored Oct 14, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  01ad27fa
- scheduler.py: Update the name of the default scheduler. (#26758) · 481545b3
  Ryan Li authored Oct 14, 2025
```
Signed-off-by: Ryan Li <ryanli@ryanli.org>
```
  481545b3
- [ci] Adding the test-amd.yaml for test definitions for the AMD backend. (alternative PR) (#26718) · d3cc8427
  Alexei-V-Ivanov-AMD authored Oct 14, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  d3cc8427
- [CI] [ROCm] Automate CC list for ROCm related issue (#26753) · 4821ac1b
  vllmellm authored Oct 14, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  4821ac1b
- Fix lora tests failure in TPU CI due to the removal of LoRA bias (#26723) · 4497c8f8
  XiongfeiWei authored Oct 13, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  4497c8f8