Commits · 29fba76781441ff38796eb0c189bbdd0497dc58c · OpenDAS / vllm_cscc

31 Jan, 2026 5 commits
- [UX] Use gguf `repo_id:quant_type` syntax for examples and docs (#33371) · 29fba767
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  29fba767
- [ModelRunner V2] Fix spec decoding + logprobs (#33391) · 876a16f4
  Nick Hill authored Jan 30, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  876a16f4
- [Attention] Move MLA `forward` from backend to layer (#33284) · aaa901ad
  Matthew Bonanni authored Jan 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aaa901ad
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 31aedfe7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  31aedfe7
- Refactor NVFP4 Linear utils for ModelOpt and CT (#33201) · 67ebaff5
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67ebaff5
30 Jan, 2026 16 commits
- [Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
  Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  c3a9752b
- [Kernel] [Helion] [1/N] Add Helion ConfigManager (#32740) · 6c1f9e4c
  Yanan Cao authored Jan 30, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  6c1f9e4c
- Fix encoder-decoder model disabling mm processor cache (#33236) · 67239c4c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  67239c4c
- [CI] Qwen3-ASR transcriptios tests (#33414) · 8ece6076
  Nicolò Lucchesi authored Jan 30, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8ece6076
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
- Disable Cascade Attention for Batch Invariance (#32561) · 8f5d5120
  Frank Wang authored Jan 30, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  8f5d5120
- Improve Mistral format checks. (#33253) · ae5b7aff
  Julien Denize authored Jan 30, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ae5b7aff
- Fix `test_moe.py` for Transformers v5 (#33413) · a11bc12d
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a11bc12d
- [Misc] Clean up HIDDEN_DEPRECATED_METRICS after metric removal (#33323) · cf896ae0
  杨朱 · Kiki authored Jan 30, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  cf896ae0
- Remove deprecated `reasoning_content` message field (#33402) · c5113f60
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c5113f60
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
- [Refactor] Move MM item count validation outside of processor (#33396) · c87eac18
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c87eac18
- [model] Add support for openPangu7B-VL (#32449) · ba45bedf
  hujiaxin0 authored Jan 30, 2026
```
Signed-off-by: hujiaxin <524446785@qq.com>
Signed-off-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
Co-authored-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
```
  ba45bedf
- Explicitly set `return_dict` for `apply_chat_template` (#33372) · 9432ed8c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9432ed8c
- [CI][AMD] Skip 4 GPUs testgroup ray tests (#33305) · 070c811d
  Ryan Rock authored Jan 29, 2026
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  070c811d
- [Model][Multimodal] Add explicit MusicFlamingo adapter (#32696) · c46b0cd0
  Wang Haoyu authored Jan 30, 2026
```
Signed-off-by: WangHaoyuuu <mailwhaoyu@gmail.com>
```
  c46b0cd0
29 Jan, 2026 11 commits
- [Chore] Move `MediaConnector` to `vllm.multimodal.media` (#33324) · 831453fc
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  831453fc
- [Multimodal] Simplify MM input definitions (#33331) · c6e7404c
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6e7404c
- [Models] Qwen3-ASR (#33312) · 8b3f0a99
  Roger Wang authored Jan 29, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  8b3f0a99
- [Voxtral] Streaming example (#33042) · 40c35038
  Patrick von Platen authored Jan 29, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  40c35038
- [Bug Fix] Handle variable-length tensors in MultiModalFlatField batching (#31751) · 615e8033
  andrii.pasternak authored Jan 29, 2026
```
Signed-off-by: Andrii Pasternak <andriipasternak31@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  615e8033
- [fix] tesdt mcp_tool_calling_streaming with a more complex math question (#32769) · 8688c3d4
  daniel-salib authored Jan 29, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  8688c3d4
- [Misc] Cleanup Kimi-K2.5's vision chunk modality entrypoints (#33157) · 3a92c6f3
  Isotr0py authored Jan 29, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3a92c6f3
- Adding optional speculator tests for larger models (#32943) · 5eeba80c
  shanjiaz authored Jan 29, 2026
```
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
```
  5eeba80c
- support returning tokenids in responses api (#33212) · 3bba2edb
  cmunley1 authored Jan 29, 2026
```
Signed-off-by: Christian Munley <cmunley@nvidia.com>
```
  3bba2edb
- [Bugfix] Fix Qwen3-VL-Reranker load. (#33298) · abb34ac4
  wang.yuqi authored Jan 29, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  abb34ac4
- [Refactor] Define MM data parser in processing info instead of processor itself (#33260) · 51550179
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51550179
28 Jan, 2026 8 commits

[UX] Enable nested configs in config yaml files (#33193) · ca196918
Michael Goin authored Jan 28, 2026

ca196918
Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
59bcc5b6

[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput... · 3e440786

Wentao Ye authored Jan 28, 2026


[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput improvement, 31.8% TPOT improvement (#32618)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

3e440786

[CI] Whisper tests `enforce_eager=False` (#33098) · 8ebf372e
Nicolò Lucchesi authored Jan 28, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
8ebf372e

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

[Misc] Provide a DeepSeek ReasoningParser with thinking enabled by default (#33221) · 8e5e40da
Chauncey authored Jan 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
8e5e40da
Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241) · 2e8de867
Or Ozeri authored Jan 28, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
2e8de867

[Quantization][Deprecation] Remove BitBlas (#32683) · 247d1a32

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

247d1a32