Commits · 64192d562402a56dc1e3a2141cfe896a7f0b52e9 · OpenDAS / vllm_cscc

"docs/kvbm/kvbm_intro.rst" did not exist on "766d3f2cf8a1ad34c2727c3afb09c960fdc0e0bd"

20 Nov, 2025 10 commits
- [Bugfix] Revert custom attention mask for gemma3-mm (#28995) · 64192d56
  Isotr0py authored Nov 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  64192d56
- [Bugfix] Handle broken frames in video loading (#29001) · fe25772a
  Canlin Guo authored Nov 20, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: 凌葭 <lvjiang.lj@alibaba-inc.com>
Co-authored-by: 凌葭 <lvjiang.lj@alibaba-inc.com>
```
  fe25772a
- [Bugfix] Fix precision loss in LoRA-wrapped RowParallelLinear by fusing bias into GEMM (#28972) · 0cca9b4d
  prashanth058 authored Nov 19, 2025
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
  0cca9b4d
- Consolidate Nvidia ModelOpt quant config handling for all quantization methods (#28076) · a8c53682
  Shengliang Xu authored Nov 19, 2025
```
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
```
  a8c53682
- [Feat] Iteration-level profiling for Torch and CUDA profiler (#28987) · fcbcba6c
  Benjamin Chislett authored Nov 19, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  fcbcba6c
- [AMD] Use Decoupled Kernel Block Size to Support AITER MLA block_size=1 (#27715) · 3fb0d909
  Qiang Zhang authored Nov 20, 2025
```
Signed-off-by: chiangzhang <chiangzhang@tencent.com>
```
  3fb0d909
- [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache... · 05c2dee7
  Kuntai Du authored Nov 20, 2025
```
[DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  05c2dee7
- [torchao] fix safetensors for sharding (#28169) · 1d642872
  liangel-02 authored Nov 19, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
  1d642872
- [Misc] Colorize logs (#29017) · 9ccef8e3
  Nick Hill authored Nov 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9ccef8e3
- [GC Debugger] Simply and improve GC Debugger Utils (#29029) · 537cc635
  Jialin Ouyang authored Nov 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  537cc635
19 Nov, 2025 30 commits
- [Refactor] Optimize `select_experts` (#28069) · 5031cd5d
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5031cd5d
- [Performance] Reduce DeepGEMM N dim restriction from 128 to 64 multiplier (#28687) · 3aaa94ac
  Alexander Matveev authored Nov 19, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  3aaa94ac
- [Feature] EPLB on Qwen3VLMoe and CompressedTensorsWNA16MoEMethod (#28849) · 8e38e998
  JartX authored Nov 20, 2025
  
  8e38e998
- [CI] Fix precommit `rope_theta` issue (#29040) · 0075bfff
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0075bfff
- [Bugfix] Move flashinfer kernel check into ```__init__``` function of ```FusedMoE``` (#29018) · cb0a7b4b
  Max Hu authored Nov 19, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
  cb0a7b4b
- [BugFix] Fix false assertion with spec-decode=[2,4,..] and TP>2 (#29036) · 8f4f77a7
  Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  8f4f77a7
- [DeepSeek] Fix DeepSeek V3.2 Rope Embedding (#28968) · 88f5b19f
  Yongye Zhu authored Nov 19, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  88f5b19f
- [MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50
  Shu Wang authored Nov 19, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  613abb50
- [BugFix] Ray with multiple nodes (#28873) · cdeec2e6
  Julien Denize authored Nov 19, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  cdeec2e6
- [Bug] Fix Batch Invariant MLA test (#28967) · 1607e664
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1607e664
- [Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4
  Qiu authored Nov 20, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
```
  2fd893b4
- Eagle: MM Cuda Graphs with MRope (#28896) · 02f5903b
  Izzy Putterman authored Nov 19, 2025
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  02f5903b
- Upstreaming aiter triton attention backend as a new backend (#28701) · ac10fd3c
  Aleksandr Malyshev authored Nov 19, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  ac10fd3c
- [Bugfix] Fix precision corruption when shared_experts_stream=None (#28942) · 9d2d5612
  杰兮 authored Nov 20, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
  9d2d5612
- [Kernels] Improve H200 Fused MoE Config (#28992) · fe69f331
  Robert Shaw authored Nov 19, 2025
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  fe69f331
- [Core] Reuse created spec tokens lists to mitigate GC cost (#28917) · 3319a493
  Jialin Ouyang authored Nov 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  3319a493
- GLM-V video segmentation solution adjustment (#28941) · 0c80efd9
  Yuxuan Zhang authored Nov 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  0c80efd9
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
- [Model][Mamba] Add selector for mamba attention backend and make it pluggable... · d44e9df7
  Shanshan Shen authored Nov 20, 2025
```
[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  d44e9df7
- [BugFix] Fix async-scheduling + FlashAttn MLA (#28990) · 48fc8b1e
  Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  48fc8b1e
- [torch.compile] caching of config fields should be opt-out by default (#26468) · 1ffe934c
  vnadathur authored Nov 19, 2025
```
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+worldexplored@users.noreply.github.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  1ffe934c
- [CI] Reorganize compile tests so new tests are automatically included in CI (#28625) · 2c8b9182
  Yanan Cao authored Nov 19, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  2c8b9182
- Relax Transformers modeling backend MoE experts check (#28952) · 4f5299f7
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4f5299f7
- [Doc]: fix typos in various files (#29010) · 09540cd9
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  09540cd9
- [Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449) · da2f6800
  Chen Bruce authored Nov 19, 2025
```
Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  da2f6800
- [config] Expose `get_total_num_hidden_layers()` in ModelConfig (#28961) · ba558c02
  Tova Movshovitz authored Nov 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ba558c02
- add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
  gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d69062c6
- [Doc]: fix typos in various files (#28945) · 7ed27f3c
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7ed27f3c
- [Model][QwenVL] Simplify cos/sin rotary embedding indexing (#28962) · 3d4e7d34
  Lukas Geiger authored Nov 19, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  3d4e7d34
- [Bugfix] Fix typo in Qwen3 Next model executor (#28960) · 73ff872d
  Gleb Kurchanov authored Nov 19, 2025
```
Signed-off-by: Gleb Kurchanov <nepherpitou@gmail.com>
```
  73ff872d