Commits · d95b4be47a3b07d38bccd34b282321f479915de2 · OpenDAS / vllm_cscc

31 Jan, 2026 1 commit

[Bugfix]: Fix display errors in TORCH_CHECK messages (#32942) · fedf6433

linhaifeng authored Feb 01, 2026


Signed-off-by: linhaifeng <1371675203@qq.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

fedf6433

29 Jan, 2026 2 commits

[Bugfix][CPU] Fix thread num for shared memory communication (#33317) · 8311f083

Li, Jiang authored Jan 29, 2026

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8311f083

[Doc]: fixing multiple typos in diverse files (#33256) · 31b25f65

Didier Durand authored Jan 29, 2026

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

31b25f65

28 Jan, 2026 3 commits

[Perf] Optimize `moe_permute` for CUTLASS FP8 (#32892) · c4e744db
Wentao Ye authored Jan 28, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
c4e744db

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

27 Jan, 2026 1 commit

[AMD][Kernel][BugFix] Use correct scale in concat_and_cache_ds_mla_kernel when on gfx942 (#32976) · 58996f35

rasmith authored Jan 27, 2026


Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

58996f35

26 Jan, 2026 1 commit
- [fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913) · 58a05b0c
  dolpm authored Jan 26, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  58a05b0c
25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
23 Jan, 2026 3 commits

[Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
4561f139

[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure... · 6cc6d92b

rasmith authored Jan 23, 2026


[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure tensors passed will be made contiguous for the kernel (#32831)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

6cc6d92b

[CI/Build][CPU] Fix failed pooling tests and macos smoke test (#32907) · 5da4c7d7

Li, Jiang authored Jan 23, 2026

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

5da4c7d7

22 Jan, 2026 3 commits
- Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3
  Eldar Kurtić authored Jan 22, 2026
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  44f08af3
- [CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across... · 744ef304
  Fadi Arafeh authored Jan 22, 2026
```
[CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across NUMA domains on Arm (#32792)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  744ef304
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
21 Jan, 2026 2 commits
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
- [Quantization][Deprecation] Deprecate HQQ (#32681) · 85f55c94
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  85f55c94
20 Jan, 2026 1 commit
- [Perf] Only clone when needed for `moe_permute` (#32273) · 6c97b9b9
  Wentao Ye authored Jan 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6c97b9b9
18 Jan, 2026 1 commit
- [Refactor] Remove unused cutlass moe problem size function (#32047) · eebc58df
  Wentao Ye authored Jan 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eebc58df
16 Jan, 2026 2 commits
- Atomics Reduce Counting Optimization for SplitK Skinny GEMMs. (#29843) · 7a103043
  Hashem Hashemi authored Jan 16, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  7a103043
- Add thread_n=64 support to Marlin MoE (#32360) · 83239ff1
  Michael Goin authored Jan 15, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  83239ff1
13 Jan, 2026 1 commit
- [Perf] Optimize grouped topk kernel, 1.2%~2% E2E Throughput improvement (#32058) · f28125d8
  Wentao Ye authored Jan 13, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f28125d8
10 Jan, 2026 2 commits

[Bugfix][Hardware][AMD] Use dynamic WARP_SIZE in sampler vectorized_process (#31295) · c60578de
Kevin McKay authored Jan 09, 2026
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
c60578de

Fuse RoPE and MLA KV-cache write (#25774) · 80fead8b

PatrykSaffer authored Jan 10, 2026


Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

80fead8b

09 Jan, 2026 4 commits

[Quant] Make static quant support all group shapes (#30833) · 0a0aa077
Lucas Wilkinson authored Jan 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
0a0aa077

[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput... · 308feab3

Wentao Ye authored Jan 09, 2026


[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

308feab3

[Perf][Kernel] Fused SiLU+Mul+Quant kernel for NVFP4 cutlass_moe (#31832) · 34cd32fe
Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
34cd32fe
[CPU] Add head sizes 80 and 112 with vec16 fallback (#31968) · 8e27663b
R3hankhan authored Jan 09, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
8e27663b

07 Jan, 2026 2 commits
- [Kernel] Support bias type in grouped_topk kernel (#31781) · 0ada960a
  Xin Yang authored Jan 07, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  0ada960a
- [Perf] Fuse stride preparation for NVFP4 cutlass_moe (#31837) · f347ac6c
  Michael Goin authored Jan 07, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f347ac6c
06 Jan, 2026 1 commit
- [Quantization][MoE] remove unused ep logic from moe marlin (#31571) · 2f4bdee6
  Jinzhen Lin authored Jan 07, 2026
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2f4bdee6
29 Dec, 2025 1 commit
- [ROCm][GPTQ][Bugfix] Fix GPTQ GEMM kernel output zeroing race condition (#30719) · 3ecfdc37
  Andreas Karatzas authored Dec 29, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3ecfdc37
24 Dec, 2025 3 commits
- [PERF] Add interleaved memory allocation to NUMA module (#30800) · 7cd288a4
  skaraban3807 authored Dec 24, 2025
  
  7cd288a4
- [DeepSeek v3.2] Remove unnecessary syncwarps (#31047) · 369f47aa
  Matthew Bonanni authored Dec 24, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  369f47aa
- [Misc] Remove unused custom ops `copy_blocks` and `copy_blocks_mla` (#30967) · 4ed11105
  rongfu.leng authored Dec 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  4ed11105
23 Dec, 2025 1 commit

[FIX] FP4 quantization kernel padding initialization bug (#31097) · b94f80ff

danielafrimi authored Dec 23, 2025



Signed-off-by: <>
Co-authored-by: root <root@gpu-193.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: root <root@gpu-951.slurm-workers-slurm.slurm.svc.cluster.local>

b94f80ff

22 Dec, 2025 2 commits
- [ROCm] [Critical]: Remove unused variable (#31156) · 022f3cea
  TJian authored Dec 23, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  022f3cea
- [Kernel] Enable fused_qknorm_rope_kernel supports partial rope (#30821) · 097978a1
  Jee Jee Li authored Dec 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  097978a1
21 Dec, 2025 1 commit
- [NVFP4][Perf] Tune NVFP4 input quant kernel for small batch size (#30897) · 06d49028
  Michael Goin authored Dec 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  06d49028
19 Dec, 2025 1 commit
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6