Commits · 31aedfe7d62adea6b5a7644f3c323f585b042ce3 · OpenDAS / vllm_cscc · GitLab

31 Jan, 2026 2 commits
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 31aedfe7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  31aedfe7
- Refactor NVFP4 Linear utils for ModelOpt and CT (#33201) · 67ebaff5
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67ebaff5
30 Jan, 2026 25 commits
- Indicate compile mode in the benchmark results (#32990) · 9ca66ecc
  Huy Do authored Jan 30, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  9ca66ecc
- [Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
  Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  c3a9752b
- [Quantization][ROCm] Fix MoE weight loading to be robust (Qwen3_MoE/Qwen3_next... · f451b455
  xuebwang-amd authored Jan 31, 2026
```
[Quantization][ROCm] Fix MoE weight loading to be robust (Qwen3_MoE/Qwen3_next as example models) (#33173)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  f451b455
- fix QERL attention import path (#33432) · 3f96fcf6
  Vasiliy Kuznetsov authored Jan 30, 2026
```
Signed-off-by: vasiliy <vasiliy@fb.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  3f96fcf6
- [Kernel] [Helion] [1/N] Add Helion ConfigManager (#32740) · 6c1f9e4c
  Yanan Cao authored Jan 30, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  6c1f9e4c
- Fix encoder-decoder model disabling mm processor cache (#33236) · 67239c4c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  67239c4c
- Support FP8 block quant for CompressedTensorsW8A16Fp8 (#33280) · fd0e3772
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  fd0e3772
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
- [BugFix][LoRA] TritonExperts is ModularMoEPath for FP8 models (#33393) · 74898a70
  Danielle Robinson authored Jan 30, 2026
```
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
```
  74898a70
- Disable Cascade Attention for Batch Invariance (#32561) · 8f5d5120
  Frank Wang authored Jan 30, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  8f5d5120
- Improve Mistral format checks. (#33253) · ae5b7aff
  Julien Denize authored Jan 30, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ae5b7aff
- Remove deprecated `reasoning_content` message field (#33402) · c5113f60
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c5113f60
- [BUGFIX] Pixtral cannot be loaded with --limit-mm-per-prompt 0 (#33406) · 8e2ad97a
  Julien Denize authored Jan 30, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  8e2ad97a
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
- [Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db
  杨朱 · Kiki authored Jan 30, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  1a7894db
- [Refactor] Move MM item count validation outside of processor (#33396) · c87eac18
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c87eac18
- fix: allow LFM2 MoE prefix caching (align) (#33376) · f45870b5
  tianshu-Michael-yu authored Jan 30, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
```
  f45870b5
- [model] Add support for openPangu7B-VL (#32449) · ba45bedf
  hujiaxin0 authored Jan 30, 2026
```
Signed-off-by: hujiaxin <524446785@qq.com>
Signed-off-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
Co-authored-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
```
  ba45bedf
- Explicitly set `return_dict` for `apply_chat_template` (#33372) · 9432ed8c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9432ed8c
- [CI] Enable mypy import following for `vllm/spec_decode` (#33282) · 726d8972
  Lucas Kabela authored Jan 29, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  726d8972
- Move decode context parallel validationn to `ParallelConfig` (#33239) · d334dd26
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d334dd26
- [Models] Refactor Kimi-K2.5 weight loading (#33346) · 8bfc8d56
  Isotr0py authored Jan 30, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8bfc8d56
- [BugFix] Disable async scheduling for Mamba prefix caching (#33352) · ec51831a
  Harry Huang authored Jan 30, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  ec51831a
- Fix `tie_word_embeddings` for multimodal models in Transformers v5 (#33359) · 80b918f2
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  80b918f2
- [Model][Multimodal] Add explicit MusicFlamingo adapter (#32696) · c46b0cd0
  Wang Haoyu authored Jan 30, 2026
```
Signed-off-by: WangHaoyuuu <mailwhaoyu@gmail.com>
```
  c46b0cd0
29 Jan, 2026 13 commits
- [Bugfix] Enable Triton MoE for FP8 per-tensor dynamic (#33300) · bfb9bdaf
  Michael Goin authored Jan 29, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bfb9bdaf
- Add Triton fused MoE config for B200 (Nemotron Nano) (#32804) · 8e2a469b
  danisereb authored Jan 29, 2026
  
  8e2a469b
- [Bugfix][Kernel] Fix negative memory offset in GDN Triton kernel (#33326) · 23591e63
  CarstyYou authored Jan 30, 2026
```
Signed-off-by: CarstyYou <186021327+CarstyYou@users.noreply.github.com>
```
  23591e63
- [NVIDIA] [feat] Integrate flashinfer Trtllmgen bf16 moe (#32954) · 0493d897
  Linda authored Jan 29, 2026
```
Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
```
  0493d897
- [BUGFIX][XPU] fix memory check after XPU reuse GPU_worker (#33358) · 8c8ebeb9
  Chendi.Xue authored Jan 29, 2026
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  8c8ebeb9
- [Chore] Move `MediaConnector` to `vllm.multimodal.media` (#33324) · 831453fc
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  831453fc
- [ez] Delete torch25_custom_graph_pass (#33287) · 5a66c9cc
  Angela Yi authored Jan 29, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  5a66c9cc
- [Bugfix] Fix broken GLM-OCR initialization (#33350) · 5e73e490
  Isotr0py authored Jan 29, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5e73e490
- [Multimodal] Simplify MM input definitions (#33331) · c6e7404c
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6e7404c
- [Backport] [Kimi-K2.5] Replace torch.cuda with current_platform for d… (#33320) · 17b17c06
  sthWrong authored Jan 29, 2026
  
  17b17c06
- [Intel GPU] refine xpu worker (#32894) · 8bb6271c
  Kunshang Ji authored Jan 29, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  8bb6271c
- [Models] Qwen3-ASR (#33312) · 8b3f0a99
  Roger Wang authored Jan 29, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  8b3f0a99
- [Bugfix][CPU] Fix thread num for shared memory communication (#33317) · 8311f083
  Li, Jiang authored Jan 29, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  8311f083