Commits · a810671a261997b5d95fee7868d79514844e6e81 · OpenDAS / vllm_cscc

18 Dec, 2025 1 commit

fused_moe_lora PDL improvements (#30716) · 5a3adf58

gnovack authored Dec 17, 2025


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

5a3adf58

16 Dec, 2025 1 commit
- [Docs][API] Remove warning about LoRARequest being internal-only (#30774) · 66c3537e
  Mark McLoughlin authored Dec 16, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  66c3537e
09 Dec, 2025 1 commit
- [Misc] Fix safetensors import for safe_open (#30300) · e4605d22
  Yongtao Huang authored Dec 09, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  e4605d22
08 Dec, 2025 2 commits
- [Misc] Split the LoRA code (#30253) · 67312cad
  Jee Jee Li authored Dec 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  67312cad
- [LoRA] Reduce the loading time of MoE LoRA (#30243) · 80433e22
  Jee Jee Li authored Dec 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  80433e22
04 Dec, 2025 2 commits
- Fix broken multiline assert in `LoRAModelManager.register_module` (#30032) · dd97e047
  Yongtao Huang authored Dec 04, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  dd97e047
- [Bugfix] Fix adapter_enabled IMA (#29977) · dd38ba3a
  Jee Jee Li authored Dec 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dd38ba3a
30 Nov, 2025 1 commit

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091

Xin Yang authored Nov 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a491b091

29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

28 Nov, 2025 2 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
27 Nov, 2025 3 commits
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
- [Bugfix] Fix getting device for MoE LoRA (#29475) · c069086b
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c069086b
24 Nov, 2025 1 commit
- [LoRA] Optimize 3D MoE logic (#29222) · 1073ba68
  Jee Jee Li authored Nov 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1073ba68
22 Nov, 2025 1 commit
- [LoRA] Cleanup FusedMoEWithLoRA (#29187) · 1489902b
  Jee Jee Li authored Nov 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1489902b
21 Nov, 2025 1 commit
- [LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
  Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9875be64
20 Nov, 2025 1 commit
- [Bugfix] Fix precision loss in LoRA-wrapped RowParallelLinear by fusing bias into GEMM (#28972) · 0cca9b4d
  prashanth058 authored Nov 19, 2025
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
  0cca9b4d
19 Nov, 2025 1 commit
- add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
  gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d69062c6
18 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28863) · 083cf326
  Didier Durand authored Nov 18, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  083cf326
14 Nov, 2025 1 commit
- [Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
  Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f3cd7f7
13 Nov, 2025 1 commit
- [XPU] Support Triton path for LoRA operations on XPU (#28511) · dbbe0c75
  Fanli Lin authored Nov 13, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  dbbe0c75
11 Nov, 2025 2 commits
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
- Fix Fused MoE LoRA Triton kernel bug (#28450) · 7dbe6d81
  Chaojun Zhang authored Nov 11, 2025
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
```
  7dbe6d81
10 Nov, 2025 1 commit
- [Kernel] Optimization of the mm_k operator. (#28280) · 40e2eeeb
  caozuoba authored Nov 11, 2025
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  40e2eeeb
08 Nov, 2025 1 commit

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068) · d0c77920

Xiaohong (Sean) Chen authored Nov 07, 2025

Signed-off-by: Sean Chen <xiaohong_chen1991@hotmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>

d0c77920

07 Nov, 2025 1 commit
- [Kernel] LoRA triton kernels support PDL (#27402) · 21b82f4e
  Jee Jee Li authored Nov 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  21b82f4e
06 Nov, 2025 1 commit

[BugFix] Fix FusedMoELoRA + ModularKernel Integration (#28237) · ca6f755d

Varun Sundar Rabindranath authored Nov 06, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

ca6f755d

05 Nov, 2025 1 commit
- [Docs] Clean up README_TUNING.md (#28088) · 518ec6b7
  Michael Yao authored Nov 06, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  518ec6b7
04 Nov, 2025 2 commits

Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435) · 2ec401bc
yugong333 authored Nov 04, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
2ec401bc

[LoRA] Lora shrink swizzle (#27694) · 6ddae740

li2haipeng authored Nov 03, 2025


Signed-off-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>
Signed-off-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

6ddae740

03 Nov, 2025 1 commit

Early exit for MoE LoRA kernels (#27131) · 294c805f

gnovack authored Nov 03, 2025


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

294c805f

01 Nov, 2025 2 commits
- Adding SplitK in fused_moe_lora kernel (#27818) · 29de3cde
  yugong333 authored Oct 31, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  29de3cde
- [Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bc4486d6
27 Oct, 2025 4 commits
- [Kernel] Enable moe LoRA kernel support FP16 (#27468) · f4e81540
  Jee Jee Li authored Oct 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f4e81540
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83
- [Kernel] Adding split_K implementation for fused_moe_lora (#27291) · 9932ed6a
  Danielle Robinson authored Oct 27, 2025
```
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9932ed6a
- [Performance][LoRA] add context varying params to 'do_not_specialize' in fused moe lora (#27445) · a806c14c
  gnovack authored Oct 26, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  a806c14c
23 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
22 Oct, 2025 1 commit
- [Bugfix] Add missing 'is_internal_router' attribute to FusedMoEWithLoRA (#27351) · 9771e0b4
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9771e0b4