Commits · 30700b1cd7de51f191be718215a58f5a8ddcb8aa · OpenDAS / vllm_cscc

10 Nov, 2025 21 commits

[CI] Fix Plugin Tests Tests (#28413) · 30700b1c
Robert Shaw authored Nov 10, 2025
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
```
30700b1c
[Frontend][2/n] remove empty content from _parse_tool_calls_from_content (#28331) · 4b94ed8f
Andrew Xia authored Nov 10, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
4b94ed8f
[BugFix] Fix DeepGEMM over-allocating workspace (#28254) · 6dec9f61
Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
6dec9f61
[Misc] Add more scoping for improved trace (#28329) · bf6a3d0f
Wei Wei authored Nov 10, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
bf6a3d0f

[Bugfix][EPLB] Disabled shared expert overlap when EPLB is enabled (#28377) · 40d33264

Sage Moore authored Nov 10, 2025

Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Sage Moore <sagemoore@utexas.edu>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

40d33264

[FA/Chore] Bump FA version for FP8 two-level accumulation (#27889) · 9c84ca82

Jonas M. Kübler authored Nov 10, 2025


Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

9c84ca82

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905) · 6d54336a

Rémi Delacourt authored Nov 10, 2025


Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

6d54336a

[Performance] Support FP8 flashinfer TRTLLM MOE on Qwen3 and Qwen-3next (#27492) · 34553b9d
jiahanc authored Nov 10, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
34553b9d

[Bugfix] Fix persistent_masked_m_silu_mul_quant tests (#28366) · b039bfda

Varun Sundar Rabindranath authored Nov 10, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

b039bfda

[V0 Deprecation] Remove unused `context_len` and `seq_len` from M-RoPE (#28395) · d0e186c1
Cyrus Leung authored Nov 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d0e186c1

[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835

vllmellm authored Nov 10, 2025


[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f080a835

[Kernel] Optimization of the mm_k operator. (#28280) · 40e2eeeb
caozuoba authored Nov 11, 2025
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
40e2eeeb

[Rocm][fused_moe][fp4] view weight to torch.float4_e2m1fn_x2 when running... · b06b9470

zejunchen-zejun authored Nov 10, 2025


[Rocm][fused_moe][fp4] view weight to torch.float4_e2m1fn_x2 when running aiter fused moe for fp4 model (#27474)
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>

b06b9470

Add @tjtanaa to codeowner for ROCm and multi-modal (#28360) · 4673e465
TJian authored Nov 10, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
4673e465

[Fix] optimize visual token mask with caching and multi-token support (#28374) · 912744d0

Ferrebo authored Nov 10, 2025

Signed-off-by: Ferrebo <itachi971009@gmail.com>
Signed-off-by: kebo01 <kebo01@baidu.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

912744d0

[bugfix] fix siglip batch text output error (#28365) · 15be507c
Yu Jiaqi authored Nov 10, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
15be507c
[Metrics] Refactor LoRA state tracking (#26801) · 6f7de33b
Mark McLoughlin authored Nov 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
6f7de33b
Restore PlaMo2 unit test as `pfnet/plamo-2-1b` now supports `transformers >=4.56` (#28019) · a98cc35c
Shinichi Hemmi authored Nov 10, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
a98cc35c
[V0 deprecation] Remove no longer used `get_metadata_cls` (#28370) · e8697faf
Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
e8697faf

[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for... · 03fa4d3f

Xiake Sun authored Nov 10, 2025


[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for Qwen3 omni for MI308X (#28373)
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xisun@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

03fa4d3f

[CI] lora/test_mixtral.py : Add additional expected outputs due to flakiness (#28322) · 6b2b9fd9
Varun Sundar Rabindranath authored Nov 09, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
6b2b9fd9

09 Nov, 2025 12 commits
- [ROCm][Platform] Add RX7900XTX device id in _ROCM_DEVICE_ID_NAME_MAP (#28279) · c5f685b3
  JartX authored Nov 10, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  c5f685b3
- [Kernel] Fix fused_gdn_gating (#28343) · c4768dcf
  Jiangyun Zhu authored Nov 10, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c4768dcf
- [CI/Build] Temporary fix to LM Eval Small Models (#28324) · a65a934e
  Zhewen Li authored Nov 09, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  a65a934e
- Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214) · 4a8d6bd1
  usberkeley authored Nov 10, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  4a8d6bd1
- [Core] Separate out attention metadata building logic from prepare inputs (#26764) · 636efd10
  Lucas Wilkinson authored Nov 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  636efd10
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
- [CI] Fix flaky `test_eagle_correctness` test (#28364) · 19d91ece
  Nicolò Lucchesi authored Nov 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  19d91ece
- [Misc] Add some comments in qwen3-next (#28267) · 7ae5a5fb
  Jiangyun Zhu authored Nov 09, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  7ae5a5fb
- [ROCm] Add env to enable/disable aiter triton gemm (#28321) · de2b7830
  Yong Hoon Shin authored Nov 08, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  de2b7830
- [Misc] fix typo and add detailed log (#28178) · e5e9067e
  Ning Xie authored Nov 09, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  e5e9067e
- fix: close issue 28338 by fixed python version (#28339) · 3a7d5803
  yihong authored Nov 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  3a7d5803
- [chore] Move some wikimedia images to S3 (#28351) · 05f8d690
  Kevin H. Luu authored Nov 08, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  05f8d690
08 Nov, 2025 7 commits
- [Performance][gpt-oss] Revert gpt-oss max cudagraph size to 1024 (#28345) · 404d7a9d
  Mohammad Miadh Angkad authored Nov 09, 2025
```
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
```
  404d7a9d
- [Bugfix] Fix test fused quant layernorm tests (#27865) · 171133f9
  ElizaWszola authored Nov 08, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  171133f9
- Remove setuptools upper bound constraint (<80) (#28337) · 32787d06
  Cole Murray authored Nov 08, 2025
```
Signed-off-by: Cole Murray <colemurray.cs@gmail.com>
```
  32787d06
- [Feat] Drop-in Torch CUDA Profiler (#27841) · 975676d1
  Benjamin Chislett authored Nov 08, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  975676d1
- Enhance run_cluster.sh for multi-NIC support (#28328) · 77d702a2
  Ev Lacey authored Nov 08, 2025
```
Signed-off-by: Ev Lacey <elacey@nvidia.com>
```
  77d702a2
- [DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571
  zhangsicheng5 authored Nov 09, 2025
```
Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>
```
  2108a571
- [Bugfix] Spec decode + structured output + spec model max len edge case (#28298) · 47604137
  Andy Lo authored Nov 08, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  47604137