Commits · 53ec16a705f27dc72d5b824a5b7ccd490f235383 · OpenDAS / vllm_cscc

12 Mar, 2026 8 commits
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [Perf] Add TRTLLM FP8 MoE Modular Kernel (#36307) · 2e693f48
  Wei Zhao authored Mar 12, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2e693f48
- [Perf] add packed recurrent fast path for decode (#36596) · 9e19f833
  caozuoba authored Mar 12, 2026
```
Signed-off-by: hdj <1293066020@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  9e19f833
- [MM][OOT] Support CPU `seq_lens` for OOT MMEncoderAttention kernels (#36605) · f0d3658c
  Shanshan Shen authored Mar 12, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f0d3658c
- [UX] Only show FP4 Marlin fallback warning for w4a4 models (#36806) · 57431d82
  Michael Goin authored Mar 12, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  57431d82
- [Bugfix] Warm up Triton autotuner for GDN layers during V1 profiling (#36599) · 3e64fe4a
  Xu Jinyang authored Mar 12, 2026
```
Signed-off-by: AuYang <459461160@qq.com>
```
  3e64fe4a
- [Bugfix][Model] Fix DeepSeek-OCR TensorSchema crash on empty images_crop (#36670) · 00726c74
  István Ketykó authored Mar 12, 2026
```
Signed-off-by: István Ketykó <istvan.ketyko@gmail.com>
```
  00726c74
- replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
  Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  894843eb
11 Mar, 2026 22 commits
- [ROCm] add tuned moe_wna16_triton kernel configs for CDNA4 (#35093) · 8a248427
  Amanzhol Salykov authored Mar 11, 2026
```
Signed-off-by: salykova <amsalykov@gmail.com>
Signed-off-by: amd-asalykov <asalykov@amd.com>
```
  8a248427
- Make Gemma and Gemma 2 accept `inputs_embeds` like Gemma 3 (#36787) · 65986db6
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  65986db6
- fix: align lfm2 thumbnail token counting with HF (#36707) · 741f4e04
  tianshu-Michael-yu authored Mar 11, 2026
  
  741f4e04
- Add 320 dimension size support to MLA (#36161) · a5d06dc5
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a5d06dc5
- [Misc] Clean up renderers (#36770) · 196802df
  Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  196802df
- [Bugfix] Fix DP/EP Shared Expert With Monolithic Kernels (#36061) · b7e5a588
  Robert Shaw authored Mar 11, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b7e5a588
- Add support to Mistral large 3 eagle with dense layers (#36163) · afebeffb
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  afebeffb
- Kimi k2.5 MLA based eagle3 (#36361) · 55738947
  Jhao-Ting Chen authored Mar 11, 2026
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>
```
  55738947
- [Misc] Use envs module to get VLLM_DISABLED_KERNELS (#35776) · 700a1ddc
  Martin Hickey authored Mar 11, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  700a1ddc
- Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
  Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
  e584dce5
- [Bugfix] Fix Qwen3-VL timestamp mismatch when using num_frames without fps (#36136) · 72475968
  Weiguang Li authored Mar 11, 2026
```
Signed-off-by: OiPunk <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  72475968
- Add: Eagle3 support for Qwen3.5 (#36658) · 9d07a3d6
  Rahul Tuli authored Mar 11, 2026
```
Signed-off-by: Rahul-Tuli <rtuli@redhat.com>
```
  9d07a3d6
- [Refactor] Remove Molmo2 processor wrapper (#36667) · 646b8554
  Cyrus Leung authored Mar 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  646b8554
- fix(minicpmv): fix audio inference by handling meta device in init_re… (#36751) · 4286cc5e
  tc-mb authored Mar 11, 2026
```
Signed-off-by: caitianchi <caitianchi@modelbest.cn>
```
  4286cc5e
- [Bugfix] Support other quantization methods in glm41v (#36321) · 545d18d8
  LoganJane authored Mar 11, 2026
```
Signed-off-by: g00887675/loganJane <g00887675/loganJane73@hotmail.com>
Co-authored-by: g00887675/loganJane <g00887675/loganJane73@hotmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  545d18d8
- Remove unused config field from Gemma2 (#36672) · f4ae58b3
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f4ae58b3
- [XPU] Support block fp8 moe by fallback to TritonExpert on XPU (#36458) · 76c6e6da
  Kunshang Ji authored Mar 11, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  76c6e6da
- [Doc] Fix duplicate words in comments (#36713) · 4bf53362
  Hongbin Guo authored Mar 11, 2026
```
Signed-off-by: Hongbin10 <jdmjdm1998@163.com>
```
  4bf53362
- [Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe
  tunglinwood authored Mar 11, 2026
```
Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>
```
  42fadebe
- Add tuned H100 MoE configs for LFM2 8B and 24B (#36699) · a197eda9
  tianshu-Michael-yu authored Mar 10, 2026
  
  a197eda9
- fix bugs when token_classify & classify run concurrently (#36614) · b386bb3d
  Augusto Yao authored Mar 11, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  b386bb3d
- [Bug] Fix TRTLLM Block FP8 MoE Monolithic (#36296) · 84e436ed
  Wei Zhao authored Mar 10, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  84e436ed
10 Mar, 2026 6 commits
- Improvements to wvSplitKrc skinny GEMM solution (#34304) · 721ae79f
  Hashem Hashemi authored Mar 10, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  721ae79f
- FunASR model bugfix (#36633) · aefc59f0
  AllenDou authored Mar 10, 2026
```
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
```
  aefc59f0
- [Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
  wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a3189a08
- Fix: Re-Enable EP for trtllm MoE FP8 backend (#36494) · 156e3355
  amirkl94 authored Mar 10, 2026
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
```
  156e3355
- [Model] Add HyperCLOVAX-SEED-Think-32B vision-language model support (#31471) · 0836be3b
  Hojin Yang authored Mar 10, 2026
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0836be3b
- [Bugfix] Fix Qwen3-Next in_proj_ba weight sharding with TP > 1 (#36242) · 4e95ec11
  Ajay Anubolu authored Mar 09, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
```
  4e95ec11
09 Mar, 2026 4 commits

[BE] Rename `should_torch_compile_mm_vit` to `should_torch_compile_mm_encoder` (#36281) · 3fd03f1e
Lucas Kabela authored Mar 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
3fd03f1e

Fix/resupport nongated fused moe triton (#36412) · fa028207

Shaun Kotek authored Mar 09, 2026


Signed-off-by: Shaun Kotek - Nvidia <skotek@nvidia.com>
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Signed-off-by: liweiguang <codingpunk@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: cong-or <conchubhar.gannon@gmail.com>
Signed-off-by: Tushar Shetty <tushar.shetty@abbyy.com>
Signed-off-by: Tushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: nvnbagrov <nbagrov@nvidia.com>
Co-authored-by: Sage <80211083+sagearc@users.noreply.github.com>
Co-authored-by: danisereb <daserebrenik@nvidia.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Weiguang Li <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: cong-or <conchubhar.gannon@gmail.com>
Co-authored-by: Tushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
Co-authored-by: liuzhenwei <zhenwei.liu@intel.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>