Commits · c6c10ca920f094f402f78635a234ffdcb108d78e · OpenDAS / vllm_cscc

"lib/bindings/vscode:/vscode.git/clone" did not exist on "af4c0cadcdfe29337f85d9b88b6ced6773d21ed2"

21 May, 2025 2 commits
- [Bugfix] Reduce moe_sum test size to avoid OOM (#18484) · c6c10ca9
  bnellnm authored May 21, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  c6c10ca9
- [Bug] Fix moe_sum signature (#18440) · 92247c52
  bnellnm authored May 21, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  92247c52
16 May, 2025 1 commit
- [Bugfix] fix rotary embedding test for _get_padded_tensor_shape (#18229) · 4e1c6a02
  Lucas Wilkinson authored May 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  4e1c6a02
15 May, 2025 1 commit
- [Bugfix] Fix fp8 tests for triton_unified_attention for Triton 3.3 (#18013) · e6b8e65d
  Thomas Parnell authored May 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  e6b8e65d
14 May, 2025 5 commits
- [Kernel] Have rotary embeddings support tensors (#18046) · d93c976a
  Lucas Wilkinson authored May 14, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  d93c976a
- Modularize fused experts and integrate PPLX kernels (#15956) · f9c069c8
  bnellnm authored May 14, 2025
  
  f9c069c8
- [FEAT] [ROCm]: Add AITER CK 2 Stages MoE support (#17110) · 612c2edb
  TJian authored May 14, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  612c2edb
- [AMD][torch.compile] Enable silu+fp8_quant fusion for rocm (#18082) · 7b2f28de
  Charlie Fu authored May 14, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  7b2f28de
- [FEAT] [ROCm] [V1]: Add AITER biased group topk for DeepSeekV3 (#17955) · 2d912fb6
  vllmellm authored May 14, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  2d912fb6
11 May, 2025 1 commit
- [Kernel] fp4 marlin kernel (#17687) · d74e5f37
  Jinzhen Lin authored May 11, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  d74e5f37
10 May, 2025 1 commit
- fix broken test vllm:test_kernels - test_attention_selector.py::test_flash_attn (#17873) · 246e3e0a
  tracelogfb authored May 09, 2025
```
Co-authored-by: Stephen Chen <tracelog@meta.com>
```
  246e3e0a
09 May, 2025 3 commits
- [Hardware/NVIDIA/Kernel] Enable nvidia/DeepSeek-R1-FP4 Model (#16362) · 0c0fdae8
  Pavani Majety authored May 09, 2025
  
  0c0fdae8
- [CI/Build] Automatically retry flaky tests (#17856) · 6e5595ca
  Cyrus Leung authored May 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6e5595ca
- [FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523) · 3c9396a6
  vllmellm authored May 09, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
```
  3c9396a6
08 May, 2025 2 commits
- Add cutlass support for blackwell fp8 blockwise gemm (#14383) · 376786fa
  Shu Wang authored May 08, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
```
  376786fa
- [Kernel][Hardware][AMD] Bf16 mfma opt for ROCm skinny GEMMs (#17071) · 5a499e70
  Hashem Hashemi authored May 07, 2025
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: charlifu <charlifu@amd.com>
```
  5a499e70
07 May, 2025 3 commits

Make key optional for rotary embedding (#17566) · 98c89e16
Yong Hoon Shin authored May 07, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
98c89e16

[Kernel] GGUF MoeVec kernel (#16780) · 1a45a613

Szymon Ożóg authored May 07, 2025


Signed-off-by: SzymonOzog <szymon.ozog@aleph-alpha.com>
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

1a45a613

[Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for... · 18dd5e01

Chih-Chieh Yang authored May 06, 2025


[Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for Corresponding Kernels (#17146)
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>

18dd5e01

06 May, 2025 3 commits
- [Kernel] Unified Triton kernel that doesn't distinguish between prefill + decode (#16828) · 2f925e57
  Thomas Parnell authored May 06, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  2f925e57
- [Bugfix] Fix triton import with local TritonPlaceholder (#17446) · f9bc5a06
  Mengqing Cao authored May 06, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  f9bc5a06
- [Misc] Fix ScalarType float4 naming (#17690) · 6eae3453
  Lucas Wilkinson authored May 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  6eae3453
05 May, 2025 1 commit
- [Kernel] some optimizations for dense marlin and moe marlin (#16850) · 1d0c9d6b
  Jinzhen Lin authored May 06, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  1d0c9d6b
02 May, 2025 1 commit
- permute/unpermute kernel for moe optimization (#14568) · 3e887d2e
  Caleb_Du authored May 03, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  3e887d2e
01 May, 2025 1 commit

[torch.compile] Add torch inductor pass for fusing silu_and_mul with... · 460a2b11

Sage Moore authored May 01, 2025


[torch.compile] Add torch inductor pass for fusing silu_and_mul with subsequent scaled_fp8_quant operations (#10867)
Signed-off-by: Sage Moore <sage@neuralmagic.com>

460a2b11

27 Apr, 2025 2 commits
- [NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032) · ed7a29d9
  Kaixi Hou authored Apr 27, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
```
  ed7a29d9
- [Kernel][Triton][FP8] Adding fp8 and variable length sequence support to... · 8e4b351a
  rasmith authored Apr 26, 2025
```
[Kernel][Triton][FP8] Adding fp8 and variable length sequence support to Triton FAv2 kernel (#12591)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  8e4b351a
26 Apr, 2025 2 commits
- Update test_flash_attn.py (#17102) · 9869453c
  Happy authored Apr 27, 2025
```
Signed-off-by: ShuaibinLi <lishuaibin@live.cn>
```
  9869453c
- Allocate kv_cache with stride order (#16605) · 9e96f56e
  Shu Wang authored Apr 26, 2025
```
Signed-off-by: shuw <shuw@nvidia.com>
```
  9e96f56e
24 Apr, 2025 1 commit
- Add missing rocm_skinny_gemms kernel test to CI (#17060) · 82e43b2d
  Michael Goin authored Apr 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82e43b2d
23 Apr, 2025 1 commit
- Categorize `tests/kernels/` based on kernel type (#16799) · 6317a517
  Michael Goin authored Apr 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6317a517
22 Apr, 2025 3 commits

[FEAT][ROCm]: Support AITER MLA (#15893) · 30bc3e0f

vllmellm authored Apr 23, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>

30bc3e0f

[Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
188b7f9b

[Kernel] Add expert_map support to Cutlass FP8 MOE (#16861) · 7b8a2ab7

Varun Sundar Rabindranath authored Apr 21, 2025


Signed-off-by: varun sundar rabindranath <vsundarr@redhat.com>
Co-authored-by: varun sundar rabindranath <vsundarr@redhat.com>

7b8a2ab7

15 Apr, 2025 2 commits

[Bugfix] Fix tests/kernels/test_mamba_ssm_ssd.py (#16623) · dbb036cf
Tyler Michael Smith authored Apr 15, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
dbb036cf

[Kernel] moe wna16 marlin kernel (#14447) · d06ba4ed

Jinzhen Lin authored Apr 15, 2025


Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

d06ba4ed

11 Apr, 2025 2 commits
- [Kernel] Support W8A8 channel-wise weights and per-token activations in triton... · f41647ee
  Michael Goin authored Apr 11, 2025
```
[Kernel] Support W8A8 channel-wise weights and per-token activations in triton fused_moe_kernel (#16366)
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f41647ee
- [Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173) · e9528f6d
  DefTruth authored Apr 11, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  e9528f6d
08 Apr, 2025 1 commit
- [Bugfix] Remove triton do_bench fast_flush arg (#16256) · e11880de
  Kebe authored Apr 08, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  e11880de
03 Apr, 2025 1 commit
- [Bugfix] Fix function names in test_block_fp8.py (#16033) · dcc56d62
  bnellnm authored Apr 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dcc56d62