Commits · 6c64c41b4abfe10f725088afb1fe143d412dc118 · OpenDAS / vllm_cscc · GitLab

31 Jan, 2026 11 commits
- [ROCm][CI] Force max_num_seqs=1 on ROCm In test_sharded_state_loader to reduce flakiness (#33277) · 6c64c41b
  Micah Williamson authored Jan 30, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  6c64c41b
- [Misc] offest -> offset in comments and variable names (#33444) · a2ef06e1
  Russell Bryant authored Jan 30, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a2ef06e1
- [BugFix] Fix whisper FA2 + full cudagraphs (#33360) · 0a3c71e7
  Lucas Wilkinson authored Jan 30, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  0a3c71e7
- [UX] Use gguf `repo_id:quant_type` syntax for examples and docs (#33371) · 29fba767
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  29fba767
- [Misc] Algin Qwen3-VL-embedding image example outputs with HF repo example (#33419) · 9df152bb
  Isotr0py authored Jan 31, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9df152bb
- [ModelRunner V2] Fix spec decoding + logprobs (#33391) · 876a16f4
  Nick Hill authored Jan 30, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  876a16f4
- [Attention] Move MLA `forward` from backend to layer (#33284) · aaa901ad
  Matthew Bonanni authored Jan 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aaa901ad
- [Deprecation] Deprecate `seed_everything` and `scatter_mm_placeholders` in v0.15 (#33362) · 010ec0c3
  Wentao Ye authored Jan 30, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  010ec0c3
- [Bugfix] Fix typo in read_offset variable name (#33426) · 64a40a7a
  Alberto Ferrer authored Jan 30, 2026
```
Signed-off-by: Alberto Ferrer <albertof@barrahome.org>
```
  64a40a7a
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 31aedfe7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  31aedfe7
- Refactor NVFP4 Linear utils for ModelOpt and CT (#33201) · 67ebaff5
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67ebaff5
30 Jan, 2026 29 commits
- [CI][HPU]accelerate hpu test by skip python re-install and clean container name (#33286) · 2b465570
  Chendi.Xue authored Jan 30, 2026
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  2b465570
- Indicate compile mode in the benchmark results (#32990) · 9ca66ecc
  Huy Do authored Jan 30, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  9ca66ecc
- [Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
  Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  c3a9752b
- [Quantization][ROCm] Fix MoE weight loading to be robust (Qwen3_MoE/Qwen3_next... · f451b455
  xuebwang-amd authored Jan 31, 2026
```
[Quantization][ROCm] Fix MoE weight loading to be robust (Qwen3_MoE/Qwen3_next as example models) (#33173)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  f451b455
- fix QERL attention import path (#33432) · 3f96fcf6
  Vasiliy Kuznetsov authored Jan 30, 2026
```
Signed-off-by: vasiliy <vasiliy@fb.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  3f96fcf6
- [Kernel] [Helion] [1/N] Add Helion ConfigManager (#32740) · 6c1f9e4c
  Yanan Cao authored Jan 30, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  6c1f9e4c
- Fix encoder-decoder model disabling mm processor cache (#33236) · 67239c4c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  67239c4c
- [CI] Qwen3-ASR transcriptios tests (#33414) · 8ece6076
  Nicolò Lucchesi authored Jan 30, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8ece6076
- Support FP8 block quant for CompressedTensorsW8A16Fp8 (#33280) · fd0e3772
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  fd0e3772
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
- [BugFix][LoRA] TritonExperts is ModularMoEPath for FP8 models (#33393) · 74898a70
  Danielle Robinson authored Jan 30, 2026
```
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
```
  74898a70
- Disable Cascade Attention for Batch Invariance (#32561) · 8f5d5120
  Frank Wang authored Jan 30, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  8f5d5120
- Improve Mistral format checks. (#33253) · ae5b7aff
  Julien Denize authored Jan 30, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ae5b7aff
- Fix `test_moe.py` for Transformers v5 (#33413) · a11bc12d
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a11bc12d
- [Doc] Enhance documentation around CPU container images (#32286) · 58cb55e4
  Nathan Weinberg authored Jan 30, 2026
```
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
```
  58cb55e4
- [Misc] Clean up HIDDEN_DEPRECATED_METRICS after metric removal (#33323) · cf896ae0
  杨朱 · Kiki authored Jan 30, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  cf896ae0
- Remove deprecated `reasoning_content` message field (#33402) · c5113f60
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c5113f60
- [Doc] [ROCm] Update Documentation to reflect v0.15.0 release (#33388) · 174f1670
  vllmellm authored Jan 30, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  174f1670
- [BUGFIX] Pixtral cannot be loaded with --limit-mm-per-prompt 0 (#33406) · 8e2ad97a
  Julien Denize authored Jan 30, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  8e2ad97a
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
- [Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db
  杨朱 · Kiki authored Jan 30, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  1a7894db
- [Refactor] Move MM item count validation outside of processor (#33396) · c87eac18
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c87eac18
- fix: allow LFM2 MoE prefix caching (align) (#33376) · f45870b5
  tianshu-Michael-yu authored Jan 30, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
```
  f45870b5
- [model] Add support for openPangu7B-VL (#32449) · ba45bedf
  hujiaxin0 authored Jan 30, 2026
```
Signed-off-by: hujiaxin <524446785@qq.com>
Signed-off-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
Co-authored-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
```
  ba45bedf
- Explicitly set `return_dict` for `apply_chat_template` (#33372) · 9432ed8c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9432ed8c
- [CI] Enable mypy import following for `vllm/spec_decode` (#33282) · 726d8972
  Lucas Kabela authored Jan 29, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  726d8972
- Move decode context parallel validationn to `ParallelConfig` (#33239) · d334dd26
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d334dd26
- [CI][AMD] Skip 4 GPUs testgroup ray tests (#33305) · 070c811d
  Ryan Rock authored Jan 29, 2026
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  070c811d
- [Models] Refactor Kimi-K2.5 weight loading (#33346) · 8bfc8d56
  Isotr0py authored Jan 30, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8bfc8d56