Commits · 7f0b8f20205c340f2a4eed88fcf8b8df40f011f2 · OpenDAS / vllm_cscc · GitLab

10 Apr, 2026 40 commits
- [Docs] Use `--torch-backend=auto` for editable install docs (#39511) · 7f0b8f20
  Michael Goin authored Apr 11, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  7f0b8f20
- [Refactor] Move MXFP8 GEMM management into MxFp8LinearKernel (#39205) · 11e2375f
  Michael Goin authored Apr 10, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  11e2375f
- Add structure to `requirements/` directory (#39024) · fc645f1a
  Harry Mellor authored Apr 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  fc645f1a
- Fix pre-commit labeled trigger system (#39523) · 2d80cf9d
  Fynn Schmitt-Ulms authored Apr 10, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  2d80cf9d
- Add Gemma4 Eagle3 support (#39450) · e7cfd7c5
  Fynn Schmitt-Ulms authored Apr 10, 2026
```
Signed-off-by: Rahul-Tuli <rtuli@redhat.com>
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Co-authored-by: Rahul-Tuli <rtuli@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  e7cfd7c5
- [Bugfix] Fix FlashInfer crash with kv_cache_dtype_skip_layers (#39002) · e816a881
  yzong-rh authored Apr 10, 2026
```
Signed-off-by: Yifan Zong <yzong@redhat.com>
```
  e816a881
- [CI] Add MultiConnector (Nixl+Offloading) e2e edge case tests (#39343) · e281cb72
  zhanqiuhu authored Apr 10, 2026
```
Signed-off-by: ZhanqiuHu <zhu@redhat.com>
```
  e281cb72
- perf(moe): add tuned fused_moe config for RTX PRO 6000 Blackwell Server Edition (#39183) · 51cfc0e7
  Manu authored Apr 10, 2026
```
Signed-off-by: manu <fortin.emmanuel@gmail.com>
```
  51cfc0e7
- feat: add logit_scale to PoolerConfig for affine score calibration (#39435) · b87575d2
  Jesus Federico authored Apr 10, 2026
```
Signed-off-by: Jesus Federico <jefp@amazon.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b87575d2
- [ROCm] [AITER] Revert AITER version to v0.1.10.post3 (#39509) · 42c6bb4b
  TJian authored Apr 11, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  42c6bb4b
- [Kernel] Porting the TRTLLM minimax_allreduce_rms kernels (#37045) · ecd1ea13
  Jee Jee Li authored Apr 11, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ecd1ea13
- [Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend (#32936) · 8f121f78
  zhrrr authored Apr 10, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  8f121f78
- [New Model]: jinaai/jina-reranker-v3 (#38800) · cb5f7501
  wang.yuqi authored Apr 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  cb5f7501
- [Model] Implement LoRA support for Qwen3ASRForConditionalGeneration (#37247) · 8d0f908b
  Peter Nguyen authored Apr 10, 2026
```
Signed-off-by: Peter Nguyen <petern0408@gmail.com>
```
  8d0f908b
- [CI] Add Nixl+OffloadingConnector e2e integration tests (#39200) · c9dddc14
  Nicolò Lucchesi authored Apr 10, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  c9dddc14
- [ROCm] Add RDNA 3.5/4 device IDs (gfx1150, gfx1151, gfx1201) (#38455) · c1cc7344
  Ravitez Dondeti authored Apr 10, 2026
```
Signed-off-by: rdondeti <ravitez.dondeti@gmail.com>
Signed-off-by: Ravitez Dondeti <ravitez.dondeti@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  c1cc7344
- [Performance] Remove unnecessary zero-fill of MLA decode output tensor in Aiter backend (#37539) · f976e3b9
  xaguilar-amd authored Apr 10, 2026
```
Signed-off-by: xaguilar-amd <xaguilar@amd.com>
```
  f976e3b9
- [Kernel][Hardware][AMD] Add TritonW4A16LinearKernel for ROCm (#37352) · d468322d
  jatseng-ai authored Apr 10, 2026
```
Signed-off-by: jatseng-ai <jatseng@amd.com>
Signed-off-by: jatseng-ai <janet.tseng@amd.com>
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Matthias Gehre <matthias.gehre@amd.com>
```
  d468322d
- [model] support FireRedLID (#39290) · 967146e7
  PatchyTIS authored Apr 10, 2026
```
Signed-off-by: PatchouliTaisa <patchychen@tencent.com>
Co-authored-by: PatchouliTaisa <patchychen@tencent.com>
```
  967146e7
- [ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205) · 8e8a3bec
  Lalithnarayan C authored Apr 10, 2026
```
Signed-off-by: Lalithnarayan C <Lalithnarayan.C@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  8e8a3bec
- [PluggableLayer][3/N] Apply PluggableLayer to llm_head and vocab embedding layer (#33465) · 1dfd64c1
  Hexiang Wang authored Apr 10, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  1dfd64c1
- [Bugfix] Fix V1 dummy run writing NaN to KV cache null block (#39444) · ad720aef
  Elvir Crnčević authored Apr 10, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com>
```
  ad720aef
- Nemotron Nano VL: Streamline pixel shuffle (#37580) · 270e8a41
  milesial authored Apr 10, 2026
```
Signed-off-by: milesial <milesial@users.noreply.github.com>
```
  270e8a41
- [compile] Allow strings in custom ops without regressing compilation times (#38123) · f44afef6
  Richard Zou authored Apr 10, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  f44afef6
- [GGUF] Support non-standard quant types with prefix (e.g. UD-IQ1_S) (#39471) · 447ce222
  Injae Ryou authored Apr 10, 2026
```
Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  447ce222
- update CODEOWNERS file (#39439) · 65e4e46f
  Chendi.Xue authored Apr 10, 2026
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  65e4e46f
- [Perf] Reduce H2D pageable memory copies (#38794) · 49d20346
  jackwang2120 authored Apr 10, 2026
```
Signed-off-by: jackcfwang <jackcfwang@tencent.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  49d20346
- [Core] Change max_model_len in EngineCoreReadyResponse to be non-None (#39442) · ef076c1b
  Nick Hill authored Apr 09, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  ef076c1b
- Add platform manual_seed_all API (#38468) · ec68d53b
  Yan Ma authored Apr 10, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  ec68d53b
- [BugFix][CPU] Add CPU profiler summary file output (#38366) · 13e6b1b9
  Elham authored Apr 10, 2026
```
Signed-off-by: Elham Harirpoush <elham.harirpoush@arm.com>
```
  13e6b1b9
- [Bugfix] Fix broken explicit unquantized kv cache dtype support (#38922) · 58c0a928
  Isotr0py authored Apr 10, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  58c0a928
- [feat]: make DCP error msg clearer (#28443) · 3dd60971
  Srreyansh Sethi authored Apr 09, 2026
```
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: vnadathur <glvikramn@gmail.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
```
  3dd60971
- [KV Offload] Implement `shutdown()` in `OffloadingConnector` and related classes (#39182) · a5b17fba
  Ronen Schaffer authored Apr 10, 2026
```
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
```
  a5b17fba
- [Mergify] Update model vendor auto-label rules (#39312) · c48b2b83
  Cyrus Leung authored Apr 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c48b2b83
- Add EXAONE-4.5 (#39388) · e7a1387e
  Kyungmin Lee authored Apr 10, 2026
```
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  e7a1387e
- [BugFix] Fix OOB read in CUTLASS grouped GEMM with epilogue (#38571) · f83de719
  Lucas Wilkinson authored Apr 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  f83de719
- feat(cpu): add CPU support for draft model speculative decoding (#32662) · 445a2a4d
  Ganesh R authored Apr 10, 2026
```
Signed-off-by: R <Ganesh.R@amd.com>
```
  445a2a4d
- [CT][FP8][Marlin] refactor CompressedTensorsW8A16Fp8 to use kernel abstraction (#38244) · 55d037e2
  Kunshang Ji authored Apr 10, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  55d037e2
- [Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214) · ecbfbb8d
  Chauncey authored Apr 10, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  ecbfbb8d
- [ROCm] Fix AITER ops fake impl and minor bugs (#36092) · e0613702
  Chuan (Richard) Li authored Apr 09, 2026
```
Signed-off-by: Li <chuali@amd.com>
```
  e0613702