Commits · 05c2dee7e9f485f1e76eee084849e07c1c12a68b · OpenDAS / vllm_cscc · GitLab

20 Nov, 2025 4 commits
- [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache... · 05c2dee7
  Kuntai Du authored Nov 20, 2025
```
[DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  05c2dee7
- [torchao] fix safetensors for sharding (#28169) · 1d642872
  liangel-02 authored Nov 19, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
  1d642872
- [Misc] Colorize logs (#29017) · 9ccef8e3
  Nick Hill authored Nov 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9ccef8e3
- [GC Debugger] Simply and improve GC Debugger Utils (#29029) · 537cc635
  Jialin Ouyang authored Nov 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  537cc635
19 Nov, 2025 36 commits
- [Refactor] Optimize `select_experts` (#28069) · 5031cd5d
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5031cd5d
- [Performance] Reduce DeepGEMM N dim restriction from 128 to 64 multiplier (#28687) · 3aaa94ac
  Alexander Matveev authored Nov 19, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  3aaa94ac
- [Feature] EPLB on Qwen3VLMoe and CompressedTensorsWNA16MoEMethod (#28849) · 8e38e998
  JartX authored Nov 20, 2025
  
  8e38e998
- [CI] Fix precommit `rope_theta` issue (#29040) · 0075bfff
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0075bfff
- [Bugfix] Move flashinfer kernel check into ```__init__``` function of ```FusedMoE``` (#29018) · cb0a7b4b
  Max Hu authored Nov 19, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
  cb0a7b4b
- [BugFix] Fix false assertion with spec-decode=[2,4,..] and TP>2 (#29036) · 8f4f77a7
  Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  8f4f77a7
- [ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984) · 22e44ad5
  Micah Williamson authored Nov 19, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  22e44ad5
- [DeepSeek] Fix DeepSeek V3.2 Rope Embedding (#28968) · 88f5b19f
  Yongye Zhu authored Nov 19, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  88f5b19f
- [MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50
  Shu Wang authored Nov 19, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  613abb50
- [BugFix] Ray with multiple nodes (#28873) · cdeec2e6
  Julien Denize authored Nov 19, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  cdeec2e6
- [Bug] Fix Batch Invariant MLA test (#28967) · 1607e664
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1607e664
- [CI/Build] Fix test_prefix_prefill for AMD (#28905) · 68d72319
  Ryan Rock authored Nov 19, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  68d72319
- [Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4
  Qiu authored Nov 20, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
```
  2fd893b4
- Eagle: MM Cuda Graphs with MRope (#28896) · 02f5903b
  Izzy Putterman authored Nov 19, 2025
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  02f5903b
- Upstreaming aiter triton attention backend as a new backend (#28701) · ac10fd3c
  Aleksandr Malyshev authored Nov 19, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  ac10fd3c
- [Bugfix] Fix precision corruption when shared_experts_stream=None (#28942) · 9d2d5612
  杰兮 authored Nov 20, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
  9d2d5612
- [Kernels] Improve H200 Fused MoE Config (#28992) · fe69f331
  Robert Shaw authored Nov 19, 2025
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  fe69f331
- [Core] Reuse created spec tokens lists to mitigate GC cost (#28917) · 3319a493
  Jialin Ouyang authored Nov 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  3319a493
- Re-enable FlashInfer for Llama4 on Blackwell in e2e fusion tests (#28966) · 61728cd1
  Copilot authored Nov 19, 2025
```
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  61728cd1
- GLM-V video segmentation solution adjustment (#28941) · 0c80efd9
  Yuxuan Zhang authored Nov 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  0c80efd9
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
- [Model][Mamba] Add selector for mamba attention backend and make it pluggable... · d44e9df7
  Shanshan Shen authored Nov 20, 2025
```
[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  d44e9df7
- [BugFix] Fix async-scheduling + FlashAttn MLA (#28990) · 48fc8b1e
  Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  48fc8b1e
- [torch.compile] caching of config fields should be opt-out by default (#26468) · 1ffe934c
  vnadathur authored Nov 19, 2025
```
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+worldexplored@users.noreply.github.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  1ffe934c
- [CI] Reorganize compile tests so new tests are automatically included in CI (#28625) · 2c8b9182
  Yanan Cao authored Nov 19, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  2c8b9182
- Relax Transformers modeling backend MoE experts check (#28952) · 4f5299f7
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4f5299f7
- [Doc]: fix typos in various files (#29010) · 09540cd9
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  09540cd9
- [Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449) · da2f6800
  Chen Bruce authored Nov 19, 2025
```
Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  da2f6800
- [config] Expose `get_total_num_hidden_layers()` in ModelConfig (#28961) · ba558c02
  Tova Movshovitz authored Nov 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ba558c02
- [Docs] Take env var definition out of folded admonition (#29005) · 97cfa99d
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97cfa99d
- [CI/Build] Fix broken build on Apple M1 (#28999) · bbc6c2f1
  j20120307 authored Nov 19, 2025
```
Signed-off-by: Kan Zhu <j20120307@gmail.com>
```
  bbc6c2f1
- refactor(cpu_types_scalar.hpp): Unify scalar loop implementations using unroll_loop (#28847) · 81516095
  ihb2032 authored Nov 19, 2025
```
Signed-off-by: ihb2032 <1355790728@qq.com>
Co-authored-by: lyd1992 <liuyudong@iscas.ac.cn>
```
  81516095
- [Docs] Clean up moe_kernel_features.md (#28530) · fdf93486
  Michael Yao authored Nov 19, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  fdf93486
- add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
  gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d69062c6
- Add CPU support model (#28697) · ae4821a1
  Louie Tsai authored Nov 18, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
```
  ae4821a1
- [Doc]: fix typos in various files (#28945) · 7ed27f3c
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7ed27f3c