Commits · 715681c12710edc2b6bfb63236b09ac93cade793 · OpenDAS / vllm_cscc

13 Apr, 2026 1 commit
- [LoRA] Support dual CUDA streams-Linear Layer (#35721) · 715681c1
  Jee Jee Li authored Apr 13, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  715681c1
02 Apr, 2026 1 commit
- Revert "[Kernel] Add gpt-oss Router GEMM kernel (#37205)" (#38778) · 9bd72311
  Xin Yang authored Apr 01, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  9bd72311
01 Apr, 2026 1 commit
- [MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153) · 7cf56a59
  bnellnm authored Apr 01, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  7cf56a59
31 Mar, 2026 1 commit

[MoE Refactor] Migrate Unquantized to Full Oracle Flow (#36286) · d9b90a07

yzong-rh authored Mar 31, 2026


Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: yzong-rh <yzong@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d9b90a07

25 Mar, 2026 1 commit
- [Bugfix][ROCm][MoE] Fix mxfp4 oracle regressions from #37128 (#37787) · 679c6a3e
  Andreas Karatzas authored Mar 24, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  679c6a3e
18 Mar, 2026 1 commit
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
17 Mar, 2026 1 commit
- Add ability to replace oot ops when using lora (#37181) · 0a0a1a19
  Kyuyeun Kim authored Mar 16, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  0a0a1a19
12 Mar, 2026 1 commit

[Feature]: Remove Chunking From FusedMoE (#34086) · 2cdf9222

Xinan Miao authored Mar 13, 2026


Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Southwest <1403572259@qq.com>
Signed-off-by: southwest <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>

2cdf9222

10 Mar, 2026 1 commit
- [CI] Bump `mypy` version to 1.19.1 (#36104) · f83b933b
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f83b933b
05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

26 Feb, 2026 2 commits
- [Bugfix] Remove erroneous lower bound on LoRA vocab size constraint (#35354) · 5e58bdc7
  Lucas Wilkinson authored Feb 26, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5e58bdc7
- [BugFix] Align fused MoE-LoRA kernel config with actual weight shapes (#34396) · a1f53add
  Runkai Tao authored Feb 26, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
```
  a1f53add
25 Feb, 2026 2 commits
- [Misc][LoRA] Increase max vocab size limit to 258048 in logits processor (#34773) · 42489e43
  Bhoomit authored Feb 25, 2026
```
Signed-off-by: Bhoomit Vasani <vbhoomit@amazon.com>
```
  42489e43
- [FIX] fused moe with lora shared expert dual stream (1.07x otps) (#34933) · c2c4c461
  Jhao-Ting Chen authored Feb 24, 2026
```
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c2c4c461
16 Feb, 2026 1 commit
- [Bugfix] Add method to swap quant_method on FusedMoE to fix LoRA issues (#34453) · 5bff999d
  bnellnm authored Feb 15, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  5bff999d
12 Feb, 2026 1 commit
- [Bug Fix] Fix `naive_block_assignment` always defaulting to False due to arg misalignment (#33848) · e1d97c38
  Runkai Tao authored Feb 11, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
```
  e1d97c38
06 Feb, 2026 1 commit
- [Bugfix][Model] Support LoRA on Qwen3 Output Embedding (#29816) · 2991dd3d
  Kurt Shuster authored Feb 06, 2026
```
Signed-off-by: kurt <kurt@thinkingmachines.ai>
```
  2991dd3d
05 Feb, 2026 1 commit
- [BugFix] Fix LoRA Fp8 (#33879) · 5b2a9422
  danisereb authored Feb 05, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  5b2a9422
02 Feb, 2026 1 commit
- Add unpermute-aware fused MoE LoRA path (#32655) · 7320ca39
  Runkai Tao authored Feb 01, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
```
  7320ca39
30 Jan, 2026 1 commit
- [BugFix][LoRA] TritonExperts is ModularMoEPath for FP8 models (#33393) · 74898a70
  Danielle Robinson authored Jan 30, 2026
```
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
```
  74898a70
21 Jan, 2026 1 commit

[Quantization][Deprecation] Deprecate HQQ (#32681) · 85f55c94

Robert Shaw authored Jan 21, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

85f55c94

19 Jan, 2026 1 commit
- Add support for LoRA adapters in Nemotron-H models (#30802) · aa7f37cc
  danisereb authored Jan 19, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  aa7f37cc
10 Jan, 2026 1 commit
- [LoRA][Perf] Improve FusedMoE LoRA performance for small rank (#32019) · 543c23be
  Xin Yang authored Jan 10, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  543c23be
09 Jan, 2026 2 commits
- fix lora moe sharding when rank < max_lora_rank (#31994) · bde38c11
  gnovack authored Jan 08, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bde38c11
- [Bugfix] Fix FusedMoE LoRA w2_output_size (#31949) · 707b240d
  Xin Yang authored Jan 08, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  707b240d
05 Jan, 2026 2 commits
- pin lora_b moe weights on cpu (#31317) · c77a993c
  gnovack authored Jan 05, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  c77a993c
- [Bugfix] Fix AttributeError: 'Stream' object has no attribute 'dp_size' (#31663) · f099cd55
  Jee Jee Li authored Jan 05, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f099cd55
31 Dec, 2025 1 commit
- [Fix] Align fused moe lora_b shape with peft (#31534) · ecd49ce7
  B-201 authored Dec 31, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
  ecd49ce7
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

30 Nov, 2025 1 commit

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091

Xin Yang authored Nov 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a491b091

28 Nov, 2025 2 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
27 Nov, 2025 2 commits
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
- [Bugfix] Fix getting device for MoE LoRA (#29475) · c069086b
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c069086b
24 Nov, 2025 1 commit
- [LoRA] Optimize 3D MoE logic (#29222) · 1073ba68
  Jee Jee Li authored Nov 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1073ba68
22 Nov, 2025 1 commit
- [LoRA] Cleanup FusedMoEWithLoRA (#29187) · 1489902b
  Jee Jee Li authored Nov 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1489902b
21 Nov, 2025 1 commit
- [LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
  Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9875be64
20 Nov, 2025 1 commit
- [Bugfix] Fix precision loss in LoRA-wrapped RowParallelLinear by fusing bias into GEMM (#28972) · 0cca9b4d
  prashanth058 authored Nov 19, 2025
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
  0cca9b4d
19 Nov, 2025 1 commit
- add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
  gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d69062c6