Commits · 196802dfa68c512b5360546003b2a35259de66da · OpenDAS / vllm_cscc

11 Mar, 2026 18 commits
- [Misc] Clean up renderers (#36770) · 196802df
  Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  196802df
- [Bugfix] Fix DP/EP Shared Expert With Monolithic Kernels (#36061) · b7e5a588
  Robert Shaw authored Mar 11, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b7e5a588
- Add support to Mistral large 3 eagle with dense layers (#36163) · afebeffb
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  afebeffb
- Kimi k2.5 MLA based eagle3 (#36361) · 55738947
  Jhao-Ting Chen authored Mar 11, 2026
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>
```
  55738947
- [Misc] Use envs module to get VLLM_DISABLED_KERNELS (#35776) · 700a1ddc
  Martin Hickey authored Mar 11, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  700a1ddc
- Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
  Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
  e584dce5
- [Bugfix] Fix Qwen3-VL timestamp mismatch when using num_frames without fps (#36136) · 72475968
  Weiguang Li authored Mar 11, 2026
```
Signed-off-by: OiPunk <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  72475968
- Add: Eagle3 support for Qwen3.5 (#36658) · 9d07a3d6
  Rahul Tuli authored Mar 11, 2026
```
Signed-off-by: Rahul-Tuli <rtuli@redhat.com>
```
  9d07a3d6
- [Refactor] Remove Molmo2 processor wrapper (#36667) · 646b8554
  Cyrus Leung authored Mar 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  646b8554
- fix(minicpmv): fix audio inference by handling meta device in init_re… (#36751) · 4286cc5e
  tc-mb authored Mar 11, 2026
```
Signed-off-by: caitianchi <caitianchi@modelbest.cn>
```
  4286cc5e
- [Bugfix] Support other quantization methods in glm41v (#36321) · 545d18d8
  LoganJane authored Mar 11, 2026
```
Signed-off-by: g00887675/loganJane <g00887675/loganJane73@hotmail.com>
Co-authored-by: g00887675/loganJane <g00887675/loganJane73@hotmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  545d18d8
- Remove unused config field from Gemma2 (#36672) · f4ae58b3
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f4ae58b3
- [XPU] Support block fp8 moe by fallback to TritonExpert on XPU (#36458) · 76c6e6da
  Kunshang Ji authored Mar 11, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  76c6e6da
- [Doc] Fix duplicate words in comments (#36713) · 4bf53362
  Hongbin Guo authored Mar 11, 2026
```
Signed-off-by: Hongbin10 <jdmjdm1998@163.com>
```
  4bf53362
- [Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe
  tunglinwood authored Mar 11, 2026
```
Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>
```
  42fadebe
- Add tuned H100 MoE configs for LFM2 8B and 24B (#36699) · a197eda9
  tianshu-Michael-yu authored Mar 10, 2026
  
  a197eda9
- fix bugs when token_classify & classify run concurrently (#36614) · b386bb3d
  Augusto Yao authored Mar 11, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  b386bb3d
- [Bug] Fix TRTLLM Block FP8 MoE Monolithic (#36296) · 84e436ed
  Wei Zhao authored Mar 10, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  84e436ed
10 Mar, 2026 6 commits
- Improvements to wvSplitKrc skinny GEMM solution (#34304) · 721ae79f
  Hashem Hashemi authored Mar 10, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  721ae79f
- FunASR model bugfix (#36633) · aefc59f0
  AllenDou authored Mar 10, 2026
```
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
```
  aefc59f0
- [Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
  wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a3189a08
- Fix: Re-Enable EP for trtllm MoE FP8 backend (#36494) · 156e3355
  amirkl94 authored Mar 10, 2026
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
```
  156e3355
- [Model] Add HyperCLOVAX-SEED-Think-32B vision-language model support (#31471) · 0836be3b
  Hojin Yang authored Mar 10, 2026
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0836be3b
- [Bugfix] Fix Qwen3-Next in_proj_ba weight sharding with TP > 1 (#36242) · 4e95ec11
  Ajay Anubolu authored Mar 09, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
```
  4e95ec11
09 Mar, 2026 10 commits

[BE] Rename `should_torch_compile_mm_vit` to `should_torch_compile_mm_encoder` (#36281) · 3fd03f1e
Lucas Kabela authored Mar 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
3fd03f1e

Fix/resupport nongated fused moe triton (#36412) · fa028207

Shaun Kotek authored Mar 09, 2026


Signed-off-by: Shaun Kotek - Nvidia <skotek@nvidia.com>
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Signed-off-by: liweiguang <codingpunk@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: cong-or <conchubhar.gannon@gmail.com>
Signed-off-by: Tushar Shetty <tushar.shetty@abbyy.com>
Signed-off-by: Tushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: nvnbagrov <nbagrov@nvidia.com>
Co-authored-by: Sage <80211083+sagearc@users.noreply.github.com>
Co-authored-by: danisereb <daserebrenik@nvidia.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Weiguang Li <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: cong-or <conchubhar.gannon@gmail.com>
Co-authored-by: Tushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
Co-authored-by: liuzhenwei <zhenwei.liu@intel.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

fa028207

[Misc] fix typo: dependant -> dependent (2 lines change) (#36511) · 55d27cca
SoluMilken authored Mar 10, 2026
```
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
```
55d27cca
[ROCM] Optimize the fused_topk_bias to use aiter instead of fallback torch ops. (#36253) · 70485a11
Taoyu Zhu authored Mar 10, 2026
```
Signed-off-by: zhutaoyu <zhutaoyu97@gmail.com>
```
70485a11
Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
77a73458

Support online use_audio_in_video (#36319) · 5578f2a4

Tianyu Guo authored Mar 09, 2026


Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5578f2a4

[Kernel] Add fused_sigmoid_gating_delta_rule_update kernel for Qwen3 Next (#35777) · dc6b5784
Xin Yang authored Mar 08, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
dc6b5784
[Misc] Move processors to `transformers_utils` (#35953) · d62856b9
Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d62856b9
Increase Flexibility for OOV Multimodal Token Handling (#34858) · bd2659a5
Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
bd2659a5
fix: Use iterator as not to store all the file loads in memory at once (#36149) · 90512b2e
Shaun Kotek authored Mar 09, 2026
```
Signed-off-by: Shaun Kotek - Nvidia <skotek@nvidia.com>
```
90512b2e

08 Mar, 2026 2 commits
- Add support for ModelOpt MXFP8 MoE models (#35986) · 0a6a3a12
  danisereb authored Mar 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  0a6a3a12
- [Model] Nano Nemotron VL - fast media preprocessing (#35657) · b7332b05
  nvnbagrov authored Mar 08, 2026
```
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
```
  b7332b05
07 Mar, 2026 4 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- Adding support to Sarvam's MoE models (#33942) · 85f50eb4
  rahul-sarvam authored Mar 08, 2026
```
Signed-off-by: rahul-sarvam <140298821+rahul-sarvam@users.noreply.github.com>
```
  85f50eb4
- [Bugfix] Fix compressed-tensors quantization failure for DeepSeek-R1 on MI300x (#36247) · ee8a2951
  vllmellm authored Mar 07, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  ee8a2951
- mla: don't update kv cache on dummy forwards (#36282) · 24a03915
  Itay Alroy authored Mar 07, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  24a03915