Commits · 6fb162447bb2eba84cb23c59dfa37321ba89cb53 · OpenDAS / vllm_cscc

11 Jul, 2025 2 commits
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [Feature] Integrate SM100 DeepGEMM support (#20087) · e2de455c
  Wentao Ye authored Jul 10, 2025
  
  e2de455c
10 Jul, 2025 2 commits

[Misc] MoE ModularKernel : Introduce TopKWeightAndReduce (#20648) · f0c98cae

Varun Sundar Rabindranath authored Jul 10, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

f0c98cae

[Bugfix] Fused MoE Modular Kernel chunking loop (#20392) · fdadb6f4

Varun Sundar Rabindranath authored Jul 10, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

fdadb6f4

09 Jul, 2025 2 commits

[Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1

fxmarty-amd authored Jul 09, 2025


Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>

332d4cb1

[Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6

Tuan, Hoang-Trong authored Jul 09, 2025


Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

47043eb6

08 Jul, 2025 1 commit
- [Bugfix] Fix Maverick correctness by filling zero to cache space in cutlass_moe (#20167) · afb7cff1
  Ming Yang authored Jul 07, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  afb7cff1
06 Jul, 2025 4 commits
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
- [V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e202dd27
- [BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491) · f73d02aa
  Vadim Gimpelson authored Jul 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  f73d02aa
- test_attention compat with coming xformers change (#20487) · c5ebe040
  Jeremy Reizenstein authored Jul 06, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c5ebe040
05 Jul, 2025 1 commit
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
04 Jul, 2025 3 commits
- [CI Bugfix] Fix pre-commit failures on main (#20502) · c108781c
  Michael Goin authored Jul 05, 2025
  
  c108781c
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 1 commit
- [Kernel] Enable fp8 support for pplx and BatchedTritonExperts. (#18864) · 78fe7753
  bnellnm authored Jul 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  78fe7753
02 Jul, 2025 3 commits
- [Kernels] MoE refactor (#19636) · c1909e7e
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
```
  c1909e7e
- [Refactor] Remove duplicate `find_free_port` (#20333) · 7058d7dd
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7058d7dd
- Enable group size 64 for Machete (#20290) · 3abfe221
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  3abfe221
01 Jul, 2025 3 commits
- [BugFix][V1][ROCm] Triton MLA uses V0 backend on V1 engine (#19067) · 96453cfa
  TY-AMD authored Jul 01, 2025
```
Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>
```
  96453cfa
- [Bugfix] Fix deepep tests (#20288) · 08d81f10
  Varun Sundar Rabindranath authored Jul 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  08d81f10
- Enable ZP Support for Machete (#20268) · 9909726d
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  9909726d
30 Jun, 2025 1 commit

[Unit Test] Add unit test for deep gemm (#20090) · 551ef163

Wentao Ye authored Jun 30, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

551ef163

28 Jun, 2025 1 commit

[Refactor] Create a function util and cache the results for `has_deepgemm`,... · 4d366936

Wentao Ye authored Jun 28, 2025


[Refactor] Create a function util and cache the results for `has_deepgemm`, `has_deepep`, `has_pplx` (#20187)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

4d366936

26 Jun, 2025 2 commits
- [Refactor] Rename commnication utils (#20091) · 56230881
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  56230881
- [Bug Fix] Fix address/port already in use error for deep_ep test (#20094) · c894c5dc
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c894c5dc
25 Jun, 2025 3 commits
- [Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward. Add... · 015fab8c
  bnellnm authored Jun 25, 2025
```
[Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward.  Add additional testing for cudagraphs. (#19717)
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  015fab8c
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
24 Jun, 2025 1 commit
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
23 Jun, 2025 1 commit

[EP+DP] Optimize the little operations in the DeepGEMM + DeepEP low latency case (#19885) · 68aaeb37

Tyler Michael Smith authored Jun 23, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

68aaeb37

17 Jun, 2025 2 commits
- [Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) · ffb2cd6b
  Wentao Ye authored Jun 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  ffb2cd6b
- Fixes IMA for TP w/ flex-attention (#19712) · ddfed314
  Driss Guessous authored Jun 16, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  ddfed314
15 Jun, 2025 1 commit
- [Kernel] Raise verbose error and consolidate `num_heads/num_kv_heads` divisibility check (#19339) · 0b73736a
  22quinn authored Jun 14, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  0b73736a
12 Jun, 2025 2 commits
- [Perf] Vectorize static / dynamic INT8 quant kernels (#19233) · b6efafd9
  Wentao Ye authored Jun 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b6efafd9
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 2 commits
- [Kernels] Add activation chunking logic to FusedMoEModularKernel (#19168) · 29fa5cac
  bnellnm authored Jun 11, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  29fa5cac
- Fix Typo in Documentation and Function Name (#19442) · 7c644ab6
  leopardracer authored Jun 11, 2025
  
  7c644ab6
10 Jun, 2025 1 commit
- Revert "[v1] Add fp32 support to v1 engine through flex attn" (#19404) · 5f1ac1e1
  Isotr0py authored Jun 10, 2025
  
  5f1ac1e1
09 Jun, 2025 1 commit
- [Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298) · 5cf2daea
  Varun Sundar Rabindranath authored Jun 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  5cf2daea