Commits · a8c536829cb7b5564f54beff97e938666f286dd6 · OpenDAS / vllm_cscc

20 Nov, 2025 8 commits
- Consolidate Nvidia ModelOpt quant config handling for all quantization methods (#28076) · a8c53682
  Shengliang Xu authored Nov 19, 2025
```
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
```
  a8c53682
- [Feat] Iteration-level profiling for Torch and CUDA profiler (#28987) · fcbcba6c
  Benjamin Chislett authored Nov 19, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  fcbcba6c
- [cpu][ci] Add initial set of tests for Arm CPUs (#28657) · 3168285f
  Fadi Arafeh authored Nov 20, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  3168285f
- [AMD] Use Decoupled Kernel Block Size to Support AITER MLA block_size=1 (#27715) · 3fb0d909
  Qiang Zhang authored Nov 20, 2025
```
Signed-off-by: chiangzhang <chiangzhang@tencent.com>
```
  3fb0d909
- [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache... · 05c2dee7
  Kuntai Du authored Nov 20, 2025
```
[DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  05c2dee7
- [torchao] fix safetensors for sharding (#28169) · 1d642872
  liangel-02 authored Nov 19, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
  1d642872
- [Misc] Colorize logs (#29017) · 9ccef8e3
  Nick Hill authored Nov 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9ccef8e3
- [GC Debugger] Simply and improve GC Debugger Utils (#29029) · 537cc635
  Jialin Ouyang authored Nov 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  537cc635
19 Nov, 2025 32 commits

[Refactor] Optimize `select_experts` (#28069) · 5031cd5d
Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
5031cd5d

[Performance] Reduce DeepGEMM N dim restriction from 128 to 64 multiplier (#28687) · 3aaa94ac

Alexander Matveev authored Nov 19, 2025


Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

3aaa94ac

[Feature] EPLB on Qwen3VLMoe and CompressedTensorsWNA16MoEMethod (#28849) · 8e38e998
JartX authored Nov 20, 2025

8e38e998
[CI] Fix precommit `rope_theta` issue (#29040) · 0075bfff
Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
0075bfff
[Bugfix] Move flashinfer kernel check into ```__init__``` function of ```FusedMoE``` (#29018) · cb0a7b4b
Max Hu authored Nov 19, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
cb0a7b4b
[BugFix] Fix false assertion with spec-decode=[2,4,..] and TP>2 (#29036) · 8f4f77a7
Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
8f4f77a7
[ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984) · 22e44ad5
Micah Williamson authored Nov 19, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
22e44ad5
[DeepSeek] Fix DeepSeek V3.2 Rope Embedding (#28968) · 88f5b19f
Yongye Zhu authored Nov 19, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
88f5b19f

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50

Shu Wang authored Nov 19, 2025


Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

613abb50

[BugFix] Ray with multiple nodes (#28873) · cdeec2e6
Julien Denize authored Nov 19, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
cdeec2e6
[Bug] Fix Batch Invariant MLA test (#28967) · 1607e664
Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1607e664
[CI/Build] Fix test_prefix_prefill for AMD (#28905) · 68d72319
Ryan Rock authored Nov 19, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
68d72319

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

Eagle: MM Cuda Graphs with MRope (#28896) · 02f5903b

Izzy Putterman authored Nov 19, 2025


Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

02f5903b

Upstreaming aiter triton attention backend as a new backend (#28701) · ac10fd3c
Aleksandr Malyshev authored Nov 19, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
ac10fd3c
[Bugfix] Fix precision corruption when shared_experts_stream=None (#28942) · 9d2d5612
杰兮 authored Nov 20, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
9d2d5612
[Kernels] Improve H200 Fused MoE Config (#28992) · fe69f331
Robert Shaw authored Nov 19, 2025
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
fe69f331
[Core] Reuse created spec tokens lists to mitigate GC cost (#28917) · 3319a493
Jialin Ouyang authored Nov 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
3319a493

Re-enable FlashInfer for Llama4 on Blackwell in e2e fusion tests (#28966) · 61728cd1

Copilot authored Nov 19, 2025

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

61728cd1

GLM-V video segmentation solution adjustment (#28941) · 0c80efd9
Yuxuan Zhang authored Nov 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
0c80efd9
Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304

[Model][Mamba] Add selector for mamba attention backend and make it pluggable... · d44e9df7

Shanshan Shen authored Nov 20, 2025


[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)
Signed-off-by: shen-shanshan <467638484@qq.com>

d44e9df7

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990) · 48fc8b1e
Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
48fc8b1e

[torch.compile] caching of config fields should be opt-out by default (#26468) · 1ffe934c

vnadathur authored Nov 19, 2025

Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+worldexplored@users.noreply.github.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1ffe934c

[CI] Reorganize compile tests so new tests are automatically included in CI (#28625) · 2c8b9182
Yanan Cao authored Nov 19, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
2c8b9182
Relax Transformers modeling backend MoE experts check (#28952) · 4f5299f7
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4f5299f7
[Doc]: fix typos in various files (#29010) · 09540cd9
Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
09540cd9

[Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449) · da2f6800

Chen Bruce authored Nov 19, 2025


Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

da2f6800

[config] Expose `get_total_num_hidden_layers()` in ModelConfig (#28961) · ba558c02

Tova Movshovitz authored Nov 19, 2025


Signed-off-by: tovam <tovam@pliops.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

ba558c02

[Docs] Take env var definition out of folded admonition (#29005) · 97cfa99d
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
97cfa99d
[CI/Build] Fix broken build on Apple M1 (#28999) · bbc6c2f1
j20120307 authored Nov 19, 2025
```
Signed-off-by: Kan Zhu <j20120307@gmail.com>
```
bbc6c2f1
refactor(cpu_types_scalar.hpp): Unify scalar loop implementations using unroll_loop (#28847) · 81516095
ihb2032 authored Nov 19, 2025
```
Signed-off-by: ihb2032 <1355790728@qq.com>
Co-authored-by: lyd1992 <liuyudong@iscas.ac.cn>
```
81516095