Commits · c3b40dc3e74dc0f552f76a01ae38b4f1385ad0af · OpenDAS / vllm_cscc

02 Feb, 2026 3 commits

[Models] Step-3.5-Flash (#33523) · c3b40dc3

csy0225 authored Feb 02, 2026


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: i-zhangmingming <i-zhangmingming@stepfun.com>
Co-authored-by: xiewuxun <xiewuxun@stepfun.com>
Co-authored-by: zetaohong <i-hongzetao@stepfun.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

c3b40dc3

[Fix] prefix cache hit rate == 0 bug with gpt-oss style models (#33524) · a01ef3fa
Yifan Qiao authored Feb 01, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
a01ef3fa
Add unpermute-aware fused MoE LoRA path (#32655) · 7320ca39
Runkai Tao authored Feb 01, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
```
7320ca39

31 Jan, 2026 17 commits
- [Misc] Fix flashinfer related tests (#33462) · 63c08894
  Roy Wang authored Feb 01, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  63c08894
- [Refactor] Move MM data parsing outside processor (#33408) · 88c3e114
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  88c3e114
- Support clear mm and encoder cache (#33452) · 22d9a056
  jma99_2333 authored Jan 31, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  22d9a056
- [BugFix][Router Replay] Capture Logical Experts with EPLB (#33013) · 13b842f2
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Jan 31, 2026
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  13b842f2
- [fix][torch.compile] Fix cold-start compilation time increase by adding kv... · 15f40b20
  Luka Govedič authored Jan 31, 2026
```
[fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Richard Zou <zou3519@gmail.com>
```
  15f40b20
- [ez] Add structured torch.compile logs (#33213) · 608b5565
  Angela Yi authored Jan 31, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  608b5565
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
- [Kernel] [Helion] [3/N] Helion kernel registry (#33203) · d5c41db3
  Yanan Cao authored Jan 30, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  d5c41db3
- Add support for Mistral Large 3 inference with Flashinfer MoE (#33174) · f0bca83e
  Dimitrios Bariamis authored Jan 31, 2026
```
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f0bca83e
- [Kernel] [Helion] [2/N] Helion kernel wrapper (#32964) · 8ecd213c
  Yanan Cao authored Jan 30, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  8ecd213c
- [Streaming -> Realtime] Rename all voxtral related classes, fn, files (#33415) · 15e0bb9c
  Patrick von Platen authored Jan 31, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  15e0bb9c
- [ROCm][CI] Force max_num_seqs=1 on ROCm In test_sharded_state_loader to reduce flakiness (#33277) · 6c64c41b
  Micah Williamson authored Jan 30, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  6c64c41b
- [UX] Use gguf `repo_id:quant_type` syntax for examples and docs (#33371) · 29fba767
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  29fba767
- [ModelRunner V2] Fix spec decoding + logprobs (#33391) · 876a16f4
  Nick Hill authored Jan 30, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  876a16f4
- [Attention] Move MLA `forward` from backend to layer (#33284) · aaa901ad
  Matthew Bonanni authored Jan 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aaa901ad
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 31aedfe7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  31aedfe7
- Refactor NVFP4 Linear utils for ModelOpt and CT (#33201) · 67ebaff5
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67ebaff5
30 Jan, 2026 16 commits
- [Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
  Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  c3a9752b
- [Kernel] [Helion] [1/N] Add Helion ConfigManager (#32740) · 6c1f9e4c
  Yanan Cao authored Jan 30, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  6c1f9e4c
- Fix encoder-decoder model disabling mm processor cache (#33236) · 67239c4c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  67239c4c
- [CI] Qwen3-ASR transcriptios tests (#33414) · 8ece6076
  Nicolò Lucchesi authored Jan 30, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8ece6076
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
- Disable Cascade Attention for Batch Invariance (#32561) · 8f5d5120
  Frank Wang authored Jan 30, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  8f5d5120
- Improve Mistral format checks. (#33253) · ae5b7aff
  Julien Denize authored Jan 30, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ae5b7aff
- Fix `test_moe.py` for Transformers v5 (#33413) · a11bc12d
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a11bc12d
- [Misc] Clean up HIDDEN_DEPRECATED_METRICS after metric removal (#33323) · cf896ae0
  杨朱 · Kiki authored Jan 30, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  cf896ae0
- Remove deprecated `reasoning_content` message field (#33402) · c5113f60
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c5113f60
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
- [Refactor] Move MM item count validation outside of processor (#33396) · c87eac18
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c87eac18
- [model] Add support for openPangu7B-VL (#32449) · ba45bedf
  hujiaxin0 authored Jan 30, 2026
```
Signed-off-by: hujiaxin <524446785@qq.com>
Signed-off-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
Co-authored-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
```
  ba45bedf
- Explicitly set `return_dict` for `apply_chat_template` (#33372) · 9432ed8c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9432ed8c
- [CI][AMD] Skip 4 GPUs testgroup ray tests (#33305) · 070c811d
  Ryan Rock authored Jan 29, 2026
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  070c811d
- [Model][Multimodal] Add explicit MusicFlamingo adapter (#32696) · c46b0cd0
  Wang Haoyu authored Jan 30, 2026
```
Signed-off-by: WangHaoyuuu <mailwhaoyu@gmail.com>
```
  c46b0cd0
29 Jan, 2026 4 commits
- [Chore] Move `MediaConnector` to `vllm.multimodal.media` (#33324) · 831453fc
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  831453fc
- [Multimodal] Simplify MM input definitions (#33331) · c6e7404c
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6e7404c
- [Models] Qwen3-ASR (#33312) · 8b3f0a99
  Roger Wang authored Jan 29, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  8b3f0a99
- [Voxtral] Streaming example (#33042) · 40c35038
  Patrick von Platen authored Jan 29, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  40c35038