Commits · 726efe177bf22874743d11dfdfef9247dbfb5ff0 · OpenDAS / vllm_cscc

20 Apr, 2026 1 commit

[MoE Refactor] Move the shared/fused expert output sum into MoERunnerBase (#35949) · 726efe17

bnellnm authored Apr 20, 2026


Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

726efe17

14 Apr, 2026 1 commit

[MoE] Move GPT OSS Triton kernel experts into fused_moe/experts/ (#39007) · 1a9353bb

Jackmin801 authored Apr 14, 2026


Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

1a9353bb

01 Apr, 2026 1 commit
- [MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153) · 7cf56a59
  bnellnm authored Apr 01, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  7cf56a59
31 Mar, 2026 1 commit

[MoE Refactor] Migrate Unquantized to Full Oracle Flow (#36286) · d9b90a07

yzong-rh authored Mar 31, 2026


Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: yzong-rh <yzong@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d9b90a07

25 Mar, 2026 1 commit
- [Bugfix][ROCm][MoE] Fix mxfp4 oracle regressions from #37128 (#37787) · 679c6a3e
  Andreas Karatzas authored Mar 24, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  679c6a3e
12 Mar, 2026 1 commit

[Feature]: Remove Chunking From FusedMoE (#34086) · 2cdf9222

Xinan Miao authored Mar 13, 2026


Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Southwest <1403572259@qq.com>
Signed-off-by: southwest <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>

2cdf9222

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

26 Feb, 2026 1 commit
- [BugFix] Align fused MoE-LoRA kernel config with actual weight shapes (#34396) · a1f53add
  Runkai Tao authored Feb 26, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
```
  a1f53add
25 Feb, 2026 1 commit
- [FIX] fused moe with lora shared expert dual stream (1.07x otps) (#34933) · c2c4c461
  Jhao-Ting Chen authored Feb 24, 2026
```
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c2c4c461
16 Feb, 2026 1 commit
- [Bugfix] Add method to swap quant_method on FusedMoE to fix LoRA issues (#34453) · 5bff999d
  bnellnm authored Feb 15, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  5bff999d
12 Feb, 2026 1 commit
- [Bug Fix] Fix `naive_block_assignment` always defaulting to False due to arg misalignment (#33848) · e1d97c38
  Runkai Tao authored Feb 11, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
```
  e1d97c38
05 Feb, 2026 1 commit
- [BugFix] Fix LoRA Fp8 (#33879) · 5b2a9422
  danisereb authored Feb 05, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  5b2a9422
02 Feb, 2026 1 commit
- Add unpermute-aware fused MoE LoRA path (#32655) · 7320ca39
  Runkai Tao authored Feb 01, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
```
  7320ca39
30 Jan, 2026 1 commit
- [BugFix][LoRA] TritonExperts is ModularMoEPath for FP8 models (#33393) · 74898a70
  Danielle Robinson authored Jan 30, 2026
```
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
```
  74898a70
19 Jan, 2026 1 commit
- Add support for LoRA adapters in Nemotron-H models (#30802) · aa7f37cc
  danisereb authored Jan 19, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  aa7f37cc
10 Jan, 2026 1 commit
- [LoRA][Perf] Improve FusedMoE LoRA performance for small rank (#32019) · 543c23be
  Xin Yang authored Jan 10, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  543c23be
09 Jan, 2026 2 commits
- fix lora moe sharding when rank < max_lora_rank (#31994) · bde38c11
  gnovack authored Jan 08, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bde38c11
- [Bugfix] Fix FusedMoE LoRA w2_output_size (#31949) · 707b240d
  Xin Yang authored Jan 08, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  707b240d
05 Jan, 2026 2 commits
- pin lora_b moe weights on cpu (#31317) · c77a993c
  gnovack authored Jan 05, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  c77a993c
- [Bugfix] Fix AttributeError: 'Stream' object has no attribute 'dp_size' (#31663) · f099cd55
  Jee Jee Li authored Jan 05, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f099cd55
31 Dec, 2025 1 commit
- [Fix] Align fused moe lora_b shape with peft (#31534) · ecd49ce7
  B-201 authored Dec 31, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
  ecd49ce7
30 Nov, 2025 1 commit

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091

Xin Yang authored Nov 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a491b091

28 Nov, 2025 2 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
27 Nov, 2025 2 commits
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
- [Bugfix] Fix getting device for MoE LoRA (#29475) · c069086b
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c069086b
24 Nov, 2025 1 commit
- [LoRA] Optimize 3D MoE logic (#29222) · 1073ba68
  Jee Jee Li authored Nov 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1073ba68
22 Nov, 2025 1 commit
- [LoRA] Cleanup FusedMoEWithLoRA (#29187) · 1489902b
  Jee Jee Li authored Nov 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1489902b
21 Nov, 2025 1 commit
- [LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
  Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9875be64
19 Nov, 2025 1 commit
- add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
  gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d69062c6
11 Nov, 2025 1 commit
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
06 Nov, 2025 1 commit

[BugFix] Fix FusedMoELoRA + ModularKernel Integration (#28237) · ca6f755d

Varun Sundar Rabindranath authored Nov 06, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

ca6f755d

04 Nov, 2025 1 commit
- Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435) · 2ec401bc
  yugong333 authored Nov 04, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2ec401bc
03 Nov, 2025 1 commit

Early exit for MoE LoRA kernels (#27131) · 294c805f

gnovack authored Nov 03, 2025


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

294c805f

01 Nov, 2025 1 commit
- [Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bc4486d6
22 Oct, 2025 2 commits
- [Bugfix] Add missing 'is_internal_router' attribute to FusedMoEWithLoRA (#27351) · 9771e0b4
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9771e0b4
- [Core] Handle MoE LoRA edge cases (#27335) · abf3db40
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  abf3db40
21 Oct, 2025 1 commit

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60