Commits · 56de443db1d50dce2624a21765c11a79dffa8740 · OpenDAS / vllm_cscc

05 Apr, 2026 7 commits

[ci] Switch some CI jobs to H200 MIG slices (#38956) · 56de443d
Kevin H. Luu authored Apr 05, 2026

56de443d

[Bug] Fix Import paths for `encoder_cudagraph` modules (#38997) · 4dd49b06

Greg Pereira authored Apr 05, 2026

Signed-off-by: greg pereira <grpereir@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

4dd49b06

[Bugfix] Fix invalid JSON in Gemma 4 streaming tool calls by stripping partial delimiters (#38992) · f53fa26e
Greg Pereira authored Apr 05, 2026
```
Signed-off-by: greg pereira <grpereir@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
f53fa26e

[Perf] Change Trtllm fp8 MoE to use Shuffled Weights and BlockMajorK Layout (#38993) · 1af6f78a

Wei Zhao authored Apr 05, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

1af6f78a

[Bugfix][MoE] Fix 6-8% decode regression: prefer multi-stream shared expert overlap (#38990) · 228023b3

Martin Vit authored Apr 05, 2026


Signed-off-by: Martin Vit <martin@voipmonitor.org>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

228023b3

[Bugfix][Spec Decode] Fix extract_hidden_states for VLM models (#38987) · 9a528260
Aaron Batilo authored Apr 05, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
9a528260
[Quantization][Deprecation] Remove Petit NVFP4 (#32694) · 968ed02a
Robert Shaw authored Apr 04, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
968ed02a

04 Apr, 2026 9 commits
- Revert "[vLLM IR] gemma_rms_norm" (#38998) · 7d266abb
  Robert Shaw authored Apr 04, 2026
  
  7d266abb
- [vLLM IR] gemma_rms_norm (#38780) · 156405d2
  Xiaoshuang Wang authored Apr 05, 2026
```
Signed-off-by: Icey <1790571317@qq.com>
```
  156405d2
- [Perf][GDN] Align TMA usage with upstream FLA (#38981) · 99e5539a
  Artem Perevedentsev authored Apr 04, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  99e5539a
- [IR][RmsNorm] pass None if not has_weight (#38961) · a88ce94b
  Linkun authored Apr 04, 2026
```
Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88ce94b
- [Bugfix][CPU] Fix macOS compatibility broken by #36487 (#38970) · 2a36d8fb
  Ziming Qi authored Apr 04, 2026
```
Signed-off-by: Ziming (2imi9) <148090931+2imi9@users.noreply.github.com>
```
  2a36d8fb
- Refactor Arctic loading to use AutoWeightsLoader (#38955) · 93726b2a
  lalit10 authored Apr 03, 2026
```
Signed-off-by: Lalit Laxminarayan Bangad <lalitbangad@gmail.com>
Co-authored-by: Lalit Laxminarayan Bangad <lalitbangad@meta.com>
```
  93726b2a
- [Bugfix] Fix DSV32 weight loading (#38870) · 8617f867
  Yongye Zhu authored Apr 03, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  8617f867
- [ROCm][CI] Fix ROCm Dockerfile conftest generation for older Docker parsers (#38959) · 06fd9ffc
  Andreas Karatzas authored Apr 03, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  06fd9ffc
- [Bug] Fix workspace manager `_current_workspaces` size (#38853) · cab4064c
  Wentao Ye authored Apr 03, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  cab4064c
03 Apr, 2026 24 commits
- [Bug] Fix compile error for `swap_blocks_batch` in CUDA 13 (#38915) · 062f1a2d
  Wentao Ye authored Apr 03, 2026
  
  062f1a2d
- [Bugfix][LoRA] Fix missing in_proj_z in Qwen3_5ForConditionalGenerati… (#38927) · 81994e1d
  elenalil-aws authored Apr 03, 2026
```
Signed-off-by: elenalil-aws <elenalil@amazon.com>
```
  81994e1d
- [ROCm][CI] Minor missing import patch (#38951) · 4b506ff9
  Andreas Karatzas authored Apr 03, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4b506ff9
- [ROCm][CI] Added back missing common deps (#38937) · 5875bb2e
  Andreas Karatzas authored Apr 03, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  5875bb2e
- [ci] Remove soft fail for AMD image build job (#38941) · f0d3ad9f
  Kevin H. Luu authored Apr 03, 2026
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  f0d3ad9f
- Removed GPU state confirmation and cleanup steps. (#38238) · 121ea5a2
  Divin Honnappa authored Apr 03, 2026
```
Signed-off-by: Divin Honnappa <divin.honnappa@amd.com>
```
  121ea5a2
- Remove MQ multi-node tests (#38934) · ab79863e
  Jeffrey Wang authored Apr 03, 2026
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  ab79863e
- [Model Runner V2] Add config validation for not-yet-supported features (#38758) · 5f1de2b1
  Nick Hill authored Apr 03, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  5f1de2b1
- [Bugfix] Re-enable Renormalize routing for TRT-LLM MoE experts (#38859) · a5a623d9
  yzong-rh authored Apr 03, 2026
```
Signed-off-by: Yifan Zong <yzong@redhat.com>
```
  a5a623d9
- [vLLM IR] add `import_ir_kernels()` to support OOT platforms (#38807) · f8c3af2d
  Xiaoshuang Wang authored Apr 04, 2026
```
Signed-off-by: Icey <1790571317@qq.com>
```
  f8c3af2d
- Fix invalid logprobs with MTP enabled and sync scheduling (#38711) · 50cd5674
  danisereb authored Apr 03, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  50cd5674
- [Frontend] new online quantization frontend (#38138) · 7b1a7423
  Vasiliy Kuznetsov authored Apr 03, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  7b1a7423
- [KVConnector] Skip `register_kv_caches` on profiling (#38558) · 97f92c6b
  Nicolò Lucchesi authored Apr 03, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  97f92c6b
- [Bugfix] Fix AWQ models batch invariance issues (#38670) · 46f02e00
  Yusuf Mohammad authored Apr 03, 2026
```
Signed-off-by: yusuf <yusuf@deeplearningmachine.mynet>
Signed-off-by: <>
Co-authored-by: yusuf <yusuf@deeplearningmachine.mynet>
```
  46f02e00
- [XPU] bump up xpu-kernel v0.1.5, transpose moe weights (#38342) · 6b487224
  Qiming Zhang authored Apr 03, 2026
```
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6b487224
- [Kernel] Add swapAB support for SM120 CUTLASS blockwise FP8 GEMM (#38325) · 580090db
  Necofish authored Apr 03, 2026
  
  580090db
- [GDN] Eliminate GPU->CPU sync in prepare_chunk_indices during prefill (#38361) · cb10b7e8
  Artem Perevedentsev authored Apr 03, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
```
  cb10b7e8
- [Intel][Triton] Support `round_int8` for Intel backend (#38825) · bf8b022e
  Mieszko Dziadowiec authored Apr 03, 2026
```
Signed-off-by: Mieszko Dziadowiec <mdziadowiec@habana.ai>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  bf8b022e
- [XPU][CI] Skip test_topp_only and test_topk_and_topp cases on Intel GPU in CI (#38904) · 40ee64c0
  xiangdong authored Apr 03, 2026
```
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
```
  40ee64c0
- [ROCm] Fix aiter persistent mode mla with q/o nhead<16 for kimi-k2.5 tp8 (#38615) · 1b117cb0
  wufann authored Apr 03, 2026
```
Signed-off-by: wufann <36477220+wufann@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1b117cb0
- [CPU] Replace OMP initialization (#36487) · abebd932
  Anton Ivanov authored Apr 03, 2026
```
Signed-off-by: Anton Ivanov <anton.ivanov@cambridgegreys.com>
```
  abebd932
- [Frontend] feat: add streaming support for token generation endpoint (#37171) · 25f2b553
  Hyeonki Hong authored Apr 03, 2026
```
Signed-off-by: Hyeonki Hong <hyeonki.hong@moreh.io>
```
  25f2b553
- [XPU][CI] Skip test_topk_only cases on Intel GPU in CI (#38899) · cb4ff07f
  xiangdong authored Apr 03, 2026
```
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
```
  cb4ff07f
- [ROCm][CI/Build] Fix the pytest hook to properly print out the summary (#38585) · a7d79fa1
  Gregory Shtrasberg authored Apr 03, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  a7d79fa1