Commits · ed0622e3a809fe399b81009c9dbb9cf7299414e6 · OpenDAS / vllm_cscc · GitLab

18 Apr, 2026 13 commits
- [Attention] TurboQuant: remove redundant random signs, add prior art attribution (#40194) · ed0622e3
  Dan Alistarh authored Apr 18, 2026
```
Signed-off-by: Dan Alistarh <d.alistarh@gmail.com>
```
  ed0622e3
- Added general ND x ND matmul and unit test for it (#39909) · b5f6c5f8
  Yusuf Mohammad authored Apr 18, 2026
```
Signed-off-by: Yusuf <yusufmohammad@live.com>
```
  b5f6c5f8
- [DOC] Add fuse_minimax_qk_norm (#39782) · bfde49e2
  Jee Jee Li authored Apr 18, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bfde49e2
- [Refactor] Drop direct dependency on librosa (#39079) · 153ba7f0
  Nick Cao authored Apr 18, 2026
```
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  153ba7f0
- [ZenCPU] AMD Zen CPU Backend with supported dtypes via zentorch weekly (#39967) · 87518c30
  Chinmay-Kulkarni-AMD authored Apr 18, 2026
```
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
```
  87518c30
- [Bugfix] Fix k_proj's bias for GLM-ASR (#40160) · aeee7ef9
  Rishapveer Singh authored Apr 18, 2026
```
Signed-off-by: Rishapveer Singh <singhrishapveer@gmail.com>
```
  aeee7ef9
- [Doc] Fix outdated source reference comment in anthropic/serving.py (#40189) · cda19ecf
  z1ying authored Apr 17, 2026
```
Signed-off-by: z1ying <tzzying@outlook.com>
```
  cda19ecf
- [Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405) · 80b18230
  Nithin Chalapathi authored Apr 17, 2026
```
Signed-off-by: Nithin Chalapathi <nithin.ch10@gmail.com>
Signed-off-by: Nithin Chalapathi <nithinc@berkeley.edu>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  80b18230
- [Doc] Add Realtime Transcription section to supported_models.md (#39845) · d0697cc7
  z1ying authored Apr 17, 2026
```
Signed-off-by: Ziying Tao <tzzying@outlook.com>
```
  d0697cc7
- [Core] Reduce mm scheduler, get_num_embed overhead (#40143) · b0755523
  milesial authored Apr 17, 2026
```
Signed-off-by: milesial <milesial@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b0755523
- [XPU] fix all_reduce all-zero accuracy issue under torch.compile (#39844) · 993859ce
  Chaojun Zhang authored Apr 18, 2026
```
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  993859ce
- [CI] Speed up test_fused_marlin_moe (#40178) · 48a65ccb
  Michael Goin authored Apr 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  48a65ccb
- [XPU]fake impl for xpu fp8_gemm (#39984) · 55842a8d
  Xinyu Chen authored Apr 18, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  55842a8d
17 Apr, 2026 25 commits
- Remove outdated tests test_mixtral_moe and test_duplicated_ignored_sequence_group (#40175) · 1f45e837
  Michael Goin authored Apr 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1f45e837
- [Kernel] Add MXFP4 W4A4 CUTLASS MoE kernel for SM100 (#37463) · a8bffaa1
  Michael Goin authored Apr 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a8bffaa1
- [Kernel] [Helion] Force disable HOP path due to performance regression (#40171) · 5cdddddd
  Yanan Cao authored Apr 17, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com>
```
  5cdddddd
- [ROCm] Fix TurboQuant on ROCm: backend routing, flash-attn compat, int64 overflow (#39953) · 6ef1efd5
  aditi-amd authored Apr 17, 2026
```
Signed-off-by: aditi <aditi.rana@amd.com>
```
  6ef1efd5
- [AMD][CI] Update DeepEP branch (#38396) · 58da4ee0
  Ryan Rock authored Apr 17, 2026
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  58da4ee0
- [ROCm][CI] Build fastsafetensors from source so it links against libamdhip64 (#39978) · 1ae11e2b
  Andreas Karatzas authored Apr 17, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  1ae11e2b
- skip fp8e4b15 on xpu (#39957) · 251c18d1
  Xinyu Chen authored Apr 18, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  251c18d1
- [Misc][UX] Map mimo reasoning and tooling parsers (#40089) · 512765d5
  Roger Wang authored Apr 17, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  512765d5
- feat: Add LoRA support for Gemma4ForConditionalGeneration (#39291) · 640cc9dd
  allgather authored Apr 17, 2026
```
Signed-off-by: allgather <all2allops@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  640cc9dd
- [BugFix] Support custom tool parsers when tool_choice is `required` and named function (#39870) · ceade195
  Jared Wen authored Apr 18, 2026
```
Signed-off-by: JaredforReal <w13431838023@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
```
  ceade195
- [Bugfix][Core] Fix stuck chunked pipeline parallelism with async scheduling (#38726) · 747256bb
  Jing Wang authored Apr 18, 2026
```
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  747256bb
- Fix TURBOQUANT backend selection in cuda.py (#40060) · 1174723e
  Michael Goin authored Apr 17, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  1174723e
- Add nvfp4 support to reshape_and_cache_flash (#37332) · 6b2b7bd0
  sychen52 authored Apr 17, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  6b2b7bd0
- Add @bbrowning to CODEOWNERS (#40141) · 70770268
  Ben Browning authored Apr 17, 2026
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  70770268
- [Bugfix] Fix empty delta detection in Qwen3XMLToolParser streaming (#40090) · 7a51b3e4
  Chauncey authored Apr 17, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  7a51b3e4
- [CPU] Refactor CPU affinity and memory management (#39781) · d02421a7
  Li, Jiang authored Apr 17, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  d02421a7
- [Models][Gemma4] Prevent GPU/CPU sync in `embed_input_ids` (#39234) · b1dc87a0
  Lukas Geiger authored Apr 17, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b1dc87a0
- [kv_offload]: Fix num CPU blocks for UniformTypeKVCacheSpecs (#39617) · 79a5b632
  Or Ozeri authored Apr 17, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  79a5b632
- [Bugfix] Add Marlin kernel in block scaled mm kernel selection. (#40105) · c0c98b8b
  Maral authored Apr 17, 2026
```
Signed-off-by: maral <maralbahari.98@gmail.com>
```
  c0c98b8b
- [Examples] Resettle Observability examples. (#40123) · 8d2cff81
  wang.yuqi authored Apr 17, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  8d2cff81
- [Misc] Improve new PR bot trigger condition (#40114) · 4f436782
  Cyrus Leung authored Apr 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4f436782
- [Doc] Add Gemma 4 to supported models list (#39607) · bf45e6d0
  z1ying authored Apr 16, 2026
```
Signed-off-by: z1ying <tzzying@outlook.com>
Signed-off-by: Ziying Tao <tzzying@outlook.com>
```
  bf45e6d0
- [CI Failure] Fix Plugin Tests (2 GPUs) Failure (#40083) · 978a4462
  wang.yuqi authored Apr 17, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
```
  978a4462
- [UX] Defer some imports on CLI paths to save ~2s (#40056) · 1948d0c4
  Michael Goin authored Apr 16, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1948d0c4
- [CI/Build] Apply ruff formatter to pass pre-commit (#40078) · 4c47710b
  Shinichi Hemmi authored Apr 17, 2026
```
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp>
```
  4c47710b
16 Apr, 2026 2 commits
- [MLA] Optimize mla indexer prepare uniform decode for MTP > 1 (#39458) · bf9a5ddb
  Giancarlo Delfin authored Apr 16, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  bf9a5ddb
- [Bugfix] Temporarily disable B200 fp4 MoE layer tests (#40057) · 79e799eb
  bnellnm authored Apr 16, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  79e799eb