Commits · 5031cd5d55ad99e8f9b31dd0020a06b346f6e493 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "c4e5bdf61b00882749f9a4184c0576b4aa4ed512"

19 Nov, 2025 40 commits

[Refactor] Optimize `select_experts` (#28069) · 5031cd5d
Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
5031cd5d

[Performance] Reduce DeepGEMM N dim restriction from 128 to 64 multiplier (#28687) · 3aaa94ac

Alexander Matveev authored Nov 19, 2025


Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

3aaa94ac

[Feature] EPLB on Qwen3VLMoe and CompressedTensorsWNA16MoEMethod (#28849) · 8e38e998
JartX authored Nov 20, 2025

8e38e998
[CI] Fix precommit `rope_theta` issue (#29040) · 0075bfff
Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
0075bfff
[Bugfix] Move flashinfer kernel check into ```__init__``` function of ```FusedMoE``` (#29018) · cb0a7b4b
Max Hu authored Nov 19, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
cb0a7b4b
[BugFix] Fix false assertion with spec-decode=[2,4,..] and TP>2 (#29036) · 8f4f77a7
Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
8f4f77a7
[ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984) · 22e44ad5
Micah Williamson authored Nov 19, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
22e44ad5
[DeepSeek] Fix DeepSeek V3.2 Rope Embedding (#28968) · 88f5b19f
Yongye Zhu authored Nov 19, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
88f5b19f

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50

Shu Wang authored Nov 19, 2025


Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

613abb50

[BugFix] Ray with multiple nodes (#28873) · cdeec2e6
Julien Denize authored Nov 19, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
cdeec2e6
[Bug] Fix Batch Invariant MLA test (#28967) · 1607e664
Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1607e664
[CI/Build] Fix test_prefix_prefill for AMD (#28905) · 68d72319
Ryan Rock authored Nov 19, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
68d72319

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

Eagle: MM Cuda Graphs with MRope (#28896) · 02f5903b

Izzy Putterman authored Nov 19, 2025


Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

02f5903b

Upstreaming aiter triton attention backend as a new backend (#28701) · ac10fd3c
Aleksandr Malyshev authored Nov 19, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
ac10fd3c
[Bugfix] Fix precision corruption when shared_experts_stream=None (#28942) · 9d2d5612
杰兮 authored Nov 20, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
9d2d5612
[Kernels] Improve H200 Fused MoE Config (#28992) · fe69f331
Robert Shaw authored Nov 19, 2025
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
fe69f331
[Core] Reuse created spec tokens lists to mitigate GC cost (#28917) · 3319a493
Jialin Ouyang authored Nov 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
3319a493

Re-enable FlashInfer for Llama4 on Blackwell in e2e fusion tests (#28966) · 61728cd1

Copilot authored Nov 19, 2025

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

61728cd1

GLM-V video segmentation solution adjustment (#28941) · 0c80efd9
Yuxuan Zhang authored Nov 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
0c80efd9
Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304

[Model][Mamba] Add selector for mamba attention backend and make it pluggable... · d44e9df7

Shanshan Shen authored Nov 20, 2025


[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)
Signed-off-by: shen-shanshan <467638484@qq.com>

d44e9df7

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990) · 48fc8b1e
Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
48fc8b1e

[torch.compile] caching of config fields should be opt-out by default (#26468) · 1ffe934c

vnadathur authored Nov 19, 2025

Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+worldexplored@users.noreply.github.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1ffe934c

[CI] Reorganize compile tests so new tests are automatically included in CI (#28625) · 2c8b9182
Yanan Cao authored Nov 19, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
2c8b9182
Relax Transformers modeling backend MoE experts check (#28952) · 4f5299f7
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4f5299f7
[Doc]: fix typos in various files (#29010) · 09540cd9
Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
09540cd9

[Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449) · da2f6800

Chen Bruce authored Nov 19, 2025


Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

da2f6800

[config] Expose `get_total_num_hidden_layers()` in ModelConfig (#28961) · ba558c02

Tova Movshovitz authored Nov 19, 2025


Signed-off-by: tovam <tovam@pliops.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

ba558c02

[Docs] Take env var definition out of folded admonition (#29005) · 97cfa99d
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
97cfa99d
[CI/Build] Fix broken build on Apple M1 (#28999) · bbc6c2f1
j20120307 authored Nov 19, 2025
```
Signed-off-by: Kan Zhu <j20120307@gmail.com>
```
bbc6c2f1
refactor(cpu_types_scalar.hpp): Unify scalar loop implementations using unroll_loop (#28847) · 81516095
ihb2032 authored Nov 19, 2025
```
Signed-off-by: ihb2032 <1355790728@qq.com>
Co-authored-by: lyd1992 <liuyudong@iscas.ac.cn>
```
81516095
[Docs] Clean up moe_kernel_features.md (#28530) · fdf93486
Michael Yao authored Nov 19, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
fdf93486
add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
d69062c6
Add CPU support model (#28697) · ae4821a1
Louie Tsai authored Nov 18, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
```
ae4821a1
[Doc]: fix typos in various files (#28945) · 7ed27f3c
Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
7ed27f3c

Speed up macOS smoke test (#28954) · a4511e38

Michael Goin authored Nov 19, 2025


Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>

a4511e38

[Misc] Update embedding/cross encoder tests to use `mteb` v2 (#27329) · 71d0ae1c

Roman Solomatin authored Nov 19, 2025


Signed-off-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

71d0ae1c

[Model][QwenVL] Simplify cos/sin rotary embedding indexing (#28962) · 3d4e7d34
Lukas Geiger authored Nov 19, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
3d4e7d34
[Docs] Update oneshot imports (#28188) · 6a25ea5f
Uranus authored Nov 19, 2025
```
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
```
6a25ea5f