Commits · 06b557ecd9881289afcfa43458fb07329c955921 · OpenDAS / vllm_cscc

24 Jan, 2026 8 commits

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

[Models] Add `SharedFusedMoE` support to Qwen3MoE (#32082) · 8edaf385
Isotr0py authored Jan 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
8edaf385
[Tests] Standardize RNG seed utility across test files (#32982) · 0ccecf88
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0ccecf88
[Perf] Cache xpu_get_mem_info() result to avoid duplicate calls (#32983) · 14d03b8d
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
14d03b8d
[ROCm][ViT] Enable Flash Attention Triton backend on RDNA3/RDNA4 (#32944) · 97ef11dd
monajafi-amd authored Jan 23, 2026
```
Signed-off-by: mohammad najafi <mohammad.najafi@amd.com>
```
97ef11dd
[Bugfix] Fix FusedMoE LoRA kernel offs_token out of bound value (#32279) · ecc3dd66
Xin Yang authored Jan 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
ecc3dd66
[Core][Bugfix] allow graceful worker termination (#32965) · 7e1f10d5
Joe Runde authored Jan 23, 2026
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
7e1f10d5

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 28 commits
- [fix] add VLLM_OBJECT_STORAGE_SHM_BUFFER_NAME to compile factors (#32912) · 0118cdcc
  dolpm authored Jan 23, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  0118cdcc
- [Bugfix] Fix missing is_layer_skipped check for FusedMoE in AWQConfig (#32935) · ebd0a17e
  joninco authored Jan 23, 2026
```
Signed-off-by: jon <joninco@bullpoint.org>
```
  ebd0a17e
- [Refactor] Clean up unused variables & func (#32692) · 37c9859f
  Wentao Ye authored Jan 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  37c9859f
- [Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
  Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4561f139
- [CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure... · 6cc6d92b
  rasmith authored Jan 23, 2026
```
[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure tensors passed will be made contiguous for the kernel (#32831)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  6cc6d92b
- fix: Add glm4_moe_lite to MLA detection (#32614) · 586a57ad
  Markus / Mark authored Jan 23, 2026
```
Signed-off-by: marksverdhei <marksverdhei@hotmail.com>
Signed-off-by: Markus / Mark <46672778+marksverdhei@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  586a57ad
- [cudagraphs] Refactor cudagraph capture loop (#32946) · 3a414595
  Lucas Wilkinson authored Jan 23, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3a414595
- [Model Runner V2] Add KV Connector support (#32742) · 8518b304
  Nick Hill authored Jan 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  8518b304
- [Bugfix][CI] Fix pre-commit (#32956) · 2d6b5371
  Matthew Bonanni authored Jan 23, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2d6b5371
- [V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2
  Harry Huang authored Jan 24, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  5206e5e2
- [Model] Enable LoRA support for internvl2 (#32397) · fec9da0a
  Matteo Fari authored Jan 23, 2026
```
Signed-off-by: Matteo Fari <matteofari06@gmail.com>
```
  fec9da0a
- [Frontend] add logprob, compression_rate to 'verbose_json' features (#31059) · 9b77bb79
  sangbumlikeagod authored Jan 24, 2026
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  9b77bb79
- [Bugfix] Fix FP8 MoE EP Weight Loading for ModelOpt Llama4 (#32886) · 1fb648bf
  baonudesifeizhai authored Jan 23, 2026
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
```
  1fb648bf
- [Misc] Postpone torch_profiler deprecation (#32867) · 7e223097
  Nicolò Lucchesi authored Jan 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  7e223097
- [Bugfix] Disable tma_aligned_scales in test_fusions_e2e (#32916) · 90c20079
  Xin Yang authored Jan 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  90c20079
- [Bugfix] Fix getting vision features in Transformer Multimodal backend (#32933) · d95d6507
  Raushan Turganbay authored Jan 23, 2026
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  d95d6507
- [Feature]: Remove DtoH Copy for lfm2_vl On Default Stream (#32815) · 13d8746c
  tianshu-Michael-yu authored Jan 23, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
```
  13d8746c
- [Benchmark][Bugfix] Fix race condtion when starting server for sweep benchmark (#32927) · 243e78c2
  Isotr0py authored Jan 23, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  243e78c2
- [Frontend][3/n] Make pooling entrypoints request schema consensus |... · 05f3d714
  wang.yuqi authored Jan 23, 2026
```
[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  05f3d714
- [Voxtral] Add new streaming arch (#32861) · 3f3f8952
  Patrick von Platen authored Jan 23, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  3f3f8952
- [CI/Build][CPU] Fix failed pooling tests and macos smoke test (#32907) · 5da4c7d7
  Li, Jiang authored Jan 23, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  5da4c7d7
- [Misc] Add `get_name` to missing AttentionBackends (#32698) · 160c6fa3
  Nicolò Lucchesi authored Jan 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  160c6fa3
- [CI][Models] Add VLM Support for Sequence Classification Conversion (#32885) · a8eb1182
  Andreas Karatzas authored Jan 23, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a8eb1182
- [Bugfix] Fix _CPU_MOE_ACT AssertionError when vLLM config not set (#32777) · fa6e599a
  Karan Bansal authored Jan 23, 2026
```
Signed-off-by: Karan Bansal <karanb192@gmail.com>
```
  fa6e599a
- [CI] Fix mypy for `vllm/v1/structured_output` (#32722) · 7ef58737
  Wentao Ye authored Jan 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7ef58737
- [torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and... · 5e4e0e51
  Luka Govedič authored Jan 22, 2026
```
[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and `QuantFP8` to avoid raw torch ops inside opaque custom ops (#32806)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  5e4e0e51
- [BugFix] deepseek_v32_encoding: Replace asserts with proper exceptions (#32884) · f61c9da7
  Rishabh Saini authored Jan 22, 2026
```
Signed-off-by: RishabhSaini <rishabhsaini01@gmail.com>
```
  f61c9da7
- [Misc] Log vLLM logo when starting server (#32796) · 7fe25588
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  7fe25588
22 Jan, 2026 4 commits
- [MoE Refactor] Move `select_experts` from `FusedMoEQuantMethod` -> `FusedMoE` (#31996) · dc917cce
  bnellnm authored Jan 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dc917cce
- [BugFix] Fix invalid flashinfer_fused_moe_blockscale_fp8 op registration (#32855) · fc56f4a0
  Fadi Arafeh authored Jan 22, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  fc56f4a0
- [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619) · d08b356e
  Xin Yang authored Jan 22, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d08b356e
- [Refactor] Remove unused tpu files (#32610) · f7448101
  Wentao Ye authored Jan 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f7448101