Commits · bbc6c2f1e5bc856a9265dfa2b379ed1d242adc33 · OpenDAS / vllm_cscc

19 Nov, 2025 3 commits
- [CI/Build] Fix broken build on Apple M1 (#28999) · bbc6c2f1
  j20120307 authored Nov 19, 2025
```
Signed-off-by: Kan Zhu <j20120307@gmail.com>
```
  bbc6c2f1
- refactor(cpu_types_scalar.hpp): Unify scalar loop implementations using unroll_loop (#28847) · 81516095
  ihb2032 authored Nov 19, 2025
```
Signed-off-by: ihb2032 <1355790728@qq.com>
Co-authored-by: lyd1992 <liuyudong@iscas.ac.cn>
```
  81516095
- [CPU] Refactor CPU WNA16 (#28826) · 20852c8f
  Li, Jiang authored Nov 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  20852c8f
17 Nov, 2025 2 commits
- Cast return value to int64_t for cache size (#28814) · e42bd8c2
  tiehexue authored Nov 18, 2025
```
Signed-off-by: tiehexue <tiehexue@hotmail.com>
```
  e42bd8c2
- [CPU][Bugfix] Fix _to_list in CPU model runner (#28824) · 577bb34f
  Li, Jiang authored Nov 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  577bb34f
15 Nov, 2025 1 commit
- Use narrow over indexing in `hadacore_transform` to prep for ABI stable (#28756) · 74b5267d
  Jane (Yuan) Xu authored Nov 15, 2025
```
Signed-off-by: Jane Xu <janeyx@meta.com>
```
  74b5267d
14 Nov, 2025 3 commits
- [ROCm][Bugfix] Fix compilation errors with fused_qknorm_rope_kernel.cu (#28682) · 8977ffb5
  Sage Moore authored Nov 14, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  8977ffb5
- [kernel] Improve FP8 PTPC on Hopper for larger shapes (#28692) · cdd70259
  czhu-cohere authored Nov 14, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  cdd70259
- [CPU][Bugfix] Fix Apple Silicon M1 compilation failure (#28681) · 622e6106
  Michael Goin authored Nov 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  622e6106
13 Nov, 2025 4 commits

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358) · fe1cd770

Varun Sundar Rabindranath authored Nov 13, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

fe1cd770

Rewrite C++ meta funcs to Python (#28595) · 06c4873d
Jane (Yuan) Xu authored Nov 13, 2025
```
Signed-off-by: Jane Xu <janeyx@meta.com>
```
06c4873d

[Hardware][PowerPC] Fix fp16 compilation error for Power in cpu attention... · 86d15bfd

Akash kaothalkar authored Nov 13, 2025


[Hardware][PowerPC] Fix fp16 compilation error for Power in cpu attention backend and bump oneDNN version (#28535)
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>

86d15bfd

Add NUMA node validation for CPU thread binding (#28555) · 4ab34f6e
usberkeley authored Nov 13, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
4ab34f6e

12 Nov, 2025 3 commits
- [Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>
```
  4ca5cd57
- [ROCm] [Bugfix] Fix `fused_qknorm_rope_kernel` rocm compatibility (#28500) · edb59a94
  TJian authored Nov 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  edb59a94
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
11 Nov, 2025 3 commits
- [Kernel] Optimize rms_norm kernel (#27931) · 6c3c0f82
  Xin Yang authored Nov 11, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  6c3c0f82
- [Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
  zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  68c09efc
- Remove weight_scale.T special case for SM90 Block FP8 CUTLASS kernel (#28431) · f9a40871
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f9a40871
10 Nov, 2025 1 commit

[Bugfix] Fix persistent_masked_m_silu_mul_quant tests (#28366) · b039bfda

Varun Sundar Rabindranath authored Nov 10, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

b039bfda

08 Nov, 2025 2 commits

[Bugfix] Fix test fused quant layernorm tests (#27865) · 171133f9

ElizaWszola authored Nov 08, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

171133f9

[Perf][DeepSeek] Add sigmoid+bias fusion to fused_grouped_topk from TRTLLM (#28124) · 08525276

Michael Goin authored Nov 08, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

08525276

07 Nov, 2025 1 commit
- [Bugfix] Use latency MOE backend as default for Flashinfer and other misc fixes (#27439) · 72b1c2ae
  Pavani Majety authored Nov 07, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  72b1c2ae
06 Nov, 2025 1 commit
- [Bugfix][Kernel] fix merge attn states when both prefix and suffix are empty (#28181) · 981cadb3
  courage17340 authored Nov 06, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  981cadb3
04 Nov, 2025 2 commits

[Perf] SM100 - add swap AB optimization to CUTLASS FP8 GEMM (#27284) · 97e3dda8

lyrisz authored Nov 04, 2025


Signed-off-by: Faqin Zhong <faqin.zhong@gmail.com>
Co-authored-by: Faqin Zhong <zhofaqin@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

97e3dda8

[CPU]Improve dynamic 4bit moe performance (#27240) · f32cbc9a
xiangze-arm authored Nov 04, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
f32cbc9a

03 Nov, 2025 1 commit

Early exit for MoE LoRA kernels (#27131) · 294c805f

gnovack authored Nov 03, 2025


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

294c805f

02 Nov, 2025 1 commit
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
24 Oct, 2025 2 commits
- [cpu][fix] Fix onednn_mm crash on consecutive matmuls with same M,K,N and different dtype (#27472) · 2080b050
  Fadi Arafeh authored Oct 24, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  2080b050
- [Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by... · 5cc6bddb
  Xiangyu Li authored Oct 24, 2025
```
[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)
```
  5cc6bddb
22 Oct, 2025 1 commit
- Bugfix - pass 'max_num_tokens_padded' into 'moe_lora_align_block_size' (#27311) · 8e4ca4d1
  gnovack authored Oct 22, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8e4ca4d1
21 Oct, 2025 3 commits

[Deepseek v3.2] Remove extra logics in indexer (#26465) · 09a7e6f6

Lain authored Oct 21, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: Lain <siyuanf@nvidia.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>

09a7e6f6

[Deepseek v3.2] Optimize top_k_per_row (#26763) · 80e94529
Daniel Cámpora authored Oct 21, 2025
```
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
```
80e94529

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60

17 Oct, 2025 4 commits

[Chore] Remove unused `PolyNorm` layer (#27110) · 3125d799
Isotr0py authored Oct 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
3125d799

[ROCm][Bugfix][Model] Fix illegal memory access when running qwen3_moe models... · b10c64c8

rasmith authored Oct 17, 2025


[ROCm][Bugfix][Model] Fix illegal memory access when running qwen3_moe models with  rms_norm (Qwen3-235B-A22B,  Qwen3-30B-A3B, etc.) (#26192)
Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Signed-off-by: rasmith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b10c64c8

[torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604) · bd7157a0
Luka Govedič authored Oct 17, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
bd7157a0
[Kernel][Performance] Fuse float cast and renormalize to topk softmax kernel (#26717) · 75c7ad99
zhrrr authored Oct 17, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
75c7ad99

16 Oct, 2025 2 commits
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
  Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fb0571b0