Commits · f3c378ffa7f95317497a2cf64ac52b09a8708bc9 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "0faab90eb006c677add65cd4c2d0f740a63e064d"

15 Oct, 2025 14 commits
- [Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (#26456) · f5ed68ef
  Yongye Zhu authored Oct 15, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  f5ed68ef
- [bugfix] Lazy import cv2 (#26869) · efdef57b
  Angela Yi authored Oct 15, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  efdef57b
- [DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656) · 302ef403
  Mengqing Cao authored Oct 15, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  302ef403
- [Bugfix][Multi Modal] Fix incorrect Molmo token processing (#26873) · 8865da15
  sangho.lee authored Oct 15, 2025
```
Signed-off-by: sanghol <sanghol@allenai.org>
```
  8865da15
- [Bugfix] Fix qwen3-omni audio truncation issue (#26815) · 8c851f6d
  Isotr0py authored Oct 15, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8c851f6d
- [BugFix] Patch inductor partitioning logic (#26735) · 7cfa420f
  Angela Yi authored Oct 14, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  7cfa420f
- [Feature] default --extra-body param to disable thinking in vllm bench serve (#26784) · a27b288e
  rongfu.leng authored Oct 15, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  a27b288e
- [Model] Add DeepSeek-V3.1 reasoning parser (split from PR #24972) (#25589) · 85a65e7f
  Tao Hui authored Oct 15, 2025
```
Signed-off-by: taohui <taohui3@gmail.com>
Signed-off-by: Tao Hui <taohui3@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  85a65e7f
- [Bugfix] Fixes prefix-repetition benchmark script (#26828) · a2986b3e
  kourosh hakhamaneshi authored Oct 14, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <Kourosh@anyscale.com>
```
  a2986b3e
- [Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a
  Morrison Turnansky authored Oct 14, 2025
```
[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  96b9aa5a
- Disable FlashInfer sampler by default (#26859) · e66d787b
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e66d787b
- [BUGFIX][NIXL] quick fix for 'assert self.connector_worker is not None' in... · bfad142e
  Chendi.Xue authored Oct 14, 2025
```
[BUGFIX][NIXL] quick fix for 'assert self.connector_worker is not None' in get_kv_connector_stats (#26851)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  bfad142e
- [Bugfix]fix Qwen3 xml tool parser (#26345) · 93546600
  Zhikaiiii authored Oct 15, 2025
```
Signed-off-by: Zhikaiiii <1658973216@qq.com>
```
  93546600
- [Core][Easy] Use envs.__getattr__ for all Unify to environment variable access (#26810) · 07ca70af
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  07ca70af
14 Oct, 2025 26 commits
- [torch.compile] Fix tests for torch==2.9 inductor partition (#26116) · 2dcd12d3
  Luka Govedič authored Oct 14, 2025
```
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  2dcd12d3
- [WideEP][P/D] Add usage stats for DP+EP and KV Connector (#26836) · 579d2e54
  Tyler Michael Smith authored Oct 14, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  579d2e54
- [frontend][gptoss] Add per turn stats into Harmony Context (#25061) · 0512c04a
  Ye Hu authored Oct 14, 2025
```
Signed-off-by: lacora <hyelacora@gmail.com>
Co-authored-by: Ye Hu <yehu@fb.com>
```
  0512c04a
- [CI Failure] Fix torchao dep failure for Quantization Test (#26824) · 7e0ef408
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7e0ef408
- [Core] Streamline some structured output related code (#26737) · 4aed506b
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4aed506b
- remove attn output view kernel (#26680) · a86b4c58
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a86b4c58
- [Minor] Group async_scheduling related fields in model runner init (#26736) · ff4810ba
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ff4810ba
- fix: response_format for completion (#23212) · 9d696492
  Nan Qin authored Oct 14, 2025
```
Signed-off-by: Nan2018 <qinnanjoshua@gmail.com>
```
  9d696492
- Added MoE configs for llama 4, H200 device with tp=4/8 tuning (#26837) · 0e658189
  Dhruvil Bhatt authored Oct 14, 2025
```
Signed-off-by: Dhruvil Bhatt <bhattdbh@amazon.com>
```
  0e658189
- [Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146) · 380f1752
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  380f1752
- [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964) · acaa2c0a
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  acaa2c0a
- [Attention][Spec Decode] FlashMLA spec decode support (#26541) · 82af928c
  Matthew Bonanni authored Oct 14, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  82af928c
- llama4_vision_rope: add HIP override to accept (q, k) and avoid (positions, q, k) mismatch (#26790) · 87efc681
  Huamin Li authored Oct 14, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  87efc681
- [Kernel][MoE] Add MoE tunings for GLM 4.6-FP8 and GLM 4.5 Air on NVidia B200 (#26818) · aba48f7d
  Ze'ev Klapow authored Oct 14, 2025
  
  aba48f7d
- [Config] Remove Unused Environment Variable `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` (#26743) · 6d87a283
  Wentao Ye authored Oct 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6d87a283
- [Feature][Responses API] Stream Function Call - harmony (#24317) · df850c49
  Chauncey authored Oct 14, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  df850c49
- [KVConnector][Metrics] Aggregate scheduler-side KVConnectorStats (#26046) · 720394de
  Qier Li authored Oct 14, 2025
```
Signed-off-by: Qier Li <kevin44036@gmail.com>
```
  720394de
- use combo kernel to fuse qk-norm and qk-rope (#26682) · ca683a2a
  Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ca683a2a
- Adjusted the model order of the model registration file (#26798) · e9f1b8c9
  汪志鹏 authored Oct 14, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  e9f1b8c9
- [DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d
  Jaya Yuan authored Oct 14, 2025
```
Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>
```
  ea97940d
- [Feature] Change vllm.py with pydantic validation (#26726) · c715ba37
  Vladislav Bronzov authored Oct 14, 2025
```
Signed-off-by: Vladislav <vladislav.bronzov@gmail.com>
Signed-off-by: Vladislav Bronzov <58587565+VladOS95-cyber@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c715ba37
- [Chore] Remove `SupportsV0Only` interface and update supported models docs (#26783) · 9c4cb683
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9c4cb683
- [NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) · 7e6edb14
  Chendi.Xue authored Oct 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  7e6edb14
- [Model] Use merge_by_field_config for MM models (O-P) (#26776) · 74704d45
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  74704d45
- [Bugfix] Standardize merging multimodal embeddings (#26771) · d2f816d6
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f816d6
- [Plugin] Make plugin group clear (#26757) · 577d4982
  wangxiyuan authored Oct 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  577d4982