Commits · 66e601ef795c27b43025ec7f4f864cac561c322e · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "5578f2a4d33b3451203fa5d43e4e6847c00b55c6"

27 Jan, 2026 8 commits

Support compress-tensors with nvfp4 or fp8 weights and modelopt with nvfp4... · 66e601ef

IriKa authored Jan 28, 2026


Support compress-tensors with nvfp4 or fp8 weights and modelopt with nvfp4 weights on Turing (#33076)
Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>

66e601ef

Support heterogeneous NemotronHPuzzle model (#32549) · 83fb2d09

danielafrimi authored Jan 27, 2026



Signed-off-by: <dafrimi@nvidia.com>
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
Signed-off-by: root <dafrimi@nvidia.com>

83fb2d09

[LoRA][Spec Decode] Support LoRA for Nemotron-H MTP models (#32265) · f3a5ee70

danisereb authored Jan 27, 2026


Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

f3a5ee70

[5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
a608b4c6
Fix weight mapping test for Transfomers v5 (#33162) · 14385c80
Harry Mellor authored Jan 27, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
14385c80
[AMD][QWEN3-NEXT] FP8 Tunings (#32042) · da8d0c44
Lifan Shen authored Jan 27, 2026
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
da8d0c44

[Models] Kimi-K2.5 (#33131) · b539f988

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b539f988

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

26 Jan, 2026 18 commits
- [Bugfix][TPU] Return a Default fp8 MoE Backend (#32908) · 510ed1e8
  XiongfeiWei authored Jan 26, 2026
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  510ed1e8
- [Bugfix][MXFP4] Call `trtllm_fp4_block_scale_moe` with kwargs (#33104) · 8caffd92
  Pengchao Wang authored Jan 26, 2026
```
Signed-off-by: Pengchao Wang <wpc@fb.com>
```
  8caffd92
- [Refactor] Remove unused `_moe_permute` function (#33108) · 8f987883
  Wentao Ye authored Jan 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  8f987883
- [Bugfix] Fix Dtypes for Pynccl Wrapper (#33030) · 43a013c3
  Robert Shaw authored Jan 26, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  43a013c3
- [Model] Bump transformers version for test registry (#33100) · c25dbee4
  Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c25dbee4
- [Bugfix] Fix Voxtral streaming slot_mapping (#33073) · 19ab0f7c
  Nicolò Lucchesi authored Jan 26, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  19ab0f7c
- [FIX] Always support TP > 4 for FP4 Gemm (#31099) · 67fe677c
  danielafrimi authored Jan 26, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: root <root@gpu-51.slurm-workers-slurm.slurm.svc.cluster.local>
```
  67fe677c
- Remove unused logic in `models/mistral.py` (#33095) · d56afd45
  Andy Lo authored Jan 26, 2026
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  d56afd45
- [ROCm][Bugfix] Fix ptpc scale load issue for fused shared expert path in deepseek mtp (#33018) · be6931ee
  Pleaplusone authored Jan 26, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  be6931ee
- [GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1
  Yuxuan Zhang authored Jan 26, 2026
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  bb17e8f1
- [Chore] Update type annotation of `input_ids` in model forward (#33063) · dcd80206
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcd80206
- [Performance] Tune Mamba selective scan kernel for B200 (#32873) · f4a0921c
  danisereb authored Jan 26, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  f4a0921c
- [Feature] Add LoRA support for Gemma3 vision components (#32764) · 208c5625
  VihaanThat authored Jan 26, 2026
  
  208c5625
- [Model] Use mm_position to compute mrope positions for Qwen3-Omni (#33010) · 6ca2c91b
  Itay Etelis authored Jan 26, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
  6ca2c91b
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687
- [StepVL] support close img patch (#32923) · 105d1045
  ltd0924 authored Jan 26, 2026
```
Signed-off-by: luotingdan <luotingdan@stepfun.com>
Signed-off-by: ltd0924 <32387785+ltd0924@users.noreply.github.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>
```
  105d1045
- [CI] Fix MHA attention test failure (AttributeError when model_config is None... · 566cdb6c
  Lucas Wilkinson authored Jan 25, 2026
```
[CI] Fix MHA attention test failure (AttributeError when model_config is None in ViT attention backend) (#33033)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  566cdb6c
- [Bugfix][VLM] Fix transformers backend embed_multimodal for Qwen2.5-VL profiling (#32969) · 22aeb430
  Andreas Karatzas authored Jan 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  22aeb430
25 Jan, 2026 3 commits

[Model] Use mm_position to compute mrope positions for Qwen2.5-Omni (#32772) · a698e8e7
Itay Etelis authored Jan 25, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
a698e8e7

[Bugfix] fix encoder cache hang in Qwen3VL (#32684) · 7e67df55

JJJYmmm authored Jan 25, 2026


Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7e67df55

[Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
fcb9df99

24 Jan, 2026 5 commits

[MLA] Fuse cat and qaunt for fp8 kv-cache (#32950) · da5e7b12
Lucas Wilkinson authored Jan 24, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
da5e7b12
feat: Complete LoRA support for MiniMaxM2 Fixes #32736 (#32763) · bc0d291b
david guan authored Jan 24, 2026
```
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
bc0d291b
[Models]: Make Multimodal config implicit in ViT implementation (#31972) · 9ad7f89f
Isotr0py authored Jan 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
9ad7f89f
[Models] Add `SharedFusedMoE` support to Qwen3MoE (#32082) · 8edaf385
Isotr0py authored Jan 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
8edaf385

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 6 commits

[Bugfix] Fix missing is_layer_skipped check for FusedMoE in AWQConfig (#32935) · ebd0a17e
joninco authored Jan 23, 2026
```
Signed-off-by: jon <joninco@bullpoint.org>
```
ebd0a17e
[Refactor] Clean up unused variables & func (#32692) · 37c9859f
Wentao Ye authored Jan 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
37c9859f
[Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
4561f139

fix: Add glm4_moe_lite to MLA detection (#32614) · 586a57ad

Markus / Mark authored Jan 23, 2026


Signed-off-by: marksverdhei <marksverdhei@hotmail.com>
Signed-off-by: Markus / Mark <46672778+marksverdhei@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

586a57ad

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

[Model] Enable LoRA support for internvl2 (#32397) · fec9da0a
Matteo Fari authored Jan 23, 2026
```
Signed-off-by: Matteo Fari <matteofari06@gmail.com>
```
fec9da0a