Commits · b8bf5c45bbbb1249bd1656557603da71e9d4c3b9 · OpenDAS / vllm_cscc

09 Jan, 2026 2 commits
- fix lora moe sharding when rank < max_lora_rank (#31994) · bde38c11
  gnovack authored Jan 08, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bde38c11
- [Bugfix] Fix FusedMoE LoRA w2_output_size (#31949) · 707b240d
  Xin Yang authored Jan 08, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  707b240d
05 Jan, 2026 2 commits
- pin lora_b moe weights on cpu (#31317) · c77a993c
  gnovack authored Jan 05, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  c77a993c
- [Bugfix] Fix AttributeError: 'Stream' object has no attribute 'dp_size' (#31663) · f099cd55
  Jee Jee Li authored Jan 05, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f099cd55
31 Dec, 2025 1 commit
- [Fix] Align fused moe lora_b shape with peft (#31534) · ecd49ce7
  B-201 authored Dec 31, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
  ecd49ce7
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

30 Nov, 2025 1 commit

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091

Xin Yang authored Nov 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a491b091

28 Nov, 2025 2 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
27 Nov, 2025 2 commits
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
- [Bugfix] Fix getting device for MoE LoRA (#29475) · c069086b
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c069086b
24 Nov, 2025 1 commit
- [LoRA] Optimize 3D MoE logic (#29222) · 1073ba68
  Jee Jee Li authored Nov 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1073ba68
22 Nov, 2025 1 commit
- [LoRA] Cleanup FusedMoEWithLoRA (#29187) · 1489902b
  Jee Jee Li authored Nov 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1489902b
21 Nov, 2025 1 commit
- [LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
  Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9875be64
20 Nov, 2025 1 commit
- [Bugfix] Fix precision loss in LoRA-wrapped RowParallelLinear by fusing bias into GEMM (#28972) · 0cca9b4d
  prashanth058 authored Nov 19, 2025
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
  0cca9b4d
19 Nov, 2025 1 commit
- add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
  gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d69062c6
14 Nov, 2025 1 commit
- [Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
  Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f3cd7f7
11 Nov, 2025 1 commit
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
06 Nov, 2025 1 commit

[BugFix] Fix FusedMoELoRA + ModularKernel Integration (#28237) · ca6f755d

Varun Sundar Rabindranath authored Nov 06, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

ca6f755d

04 Nov, 2025 1 commit
- Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435) · 2ec401bc
  yugong333 authored Nov 04, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2ec401bc
03 Nov, 2025 1 commit

Early exit for MoE LoRA kernels (#27131) · 294c805f

gnovack authored Nov 03, 2025


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

294c805f

01 Nov, 2025 1 commit
- [Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bc4486d6
22 Oct, 2025 2 commits
- [Bugfix] Add missing 'is_internal_router' attribute to FusedMoEWithLoRA (#27351) · 9771e0b4
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9771e0b4
- [Core] Handle MoE LoRA edge cases (#27335) · abf3db40
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  abf3db40
21 Oct, 2025 1 commit

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60

17 Oct, 2025 1 commit
- [Bugfix] Fix ReplicatedLinearWithLoRA (#27065) · 87bc0c49
  Jee Jee Li authored Oct 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  87bc0c49
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit

Remove LoRA bias support (#25807) · ab196ede

Ashwin Phadke authored Oct 10, 2025


Signed-off-by: Ashwin Phadke <ashwinphadke12@rediffmail.com>
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ab196ede

09 Oct, 2025 1 commit
- [V0 deprecation] Remove `QKVCrossParallelLinear` implementation (#26475) · d1ddf340
  Isotr0py authored Oct 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d1ddf340
06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
23 Sep, 2025 2 commits
- [Core] Ensure LoRA linear respect the base_layer's tp_size and tp_rank (#25487) · 5abb1179
  Jee Jee Li authored Sep 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  5abb1179
- [Core] Optimize LoRA weight loading (#25403) · 273690a5
  Jee Jee Li authored Sep 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  273690a5
17 Sep, 2025 1 commit

cleanup: remove adapter commons (#25045) · 4aa8c7b0

Simon Mo authored Sep 17, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

4aa8c7b0

11 Sep, 2025 1 commit
- Move `LoRAConfig` from `config/__init__.py` to `config/lora.py` (#24644) · 5f5271f1
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f5271f1
10 Sep, 2025 1 commit
- [Core] Split LoRA layers (#24574) · bb3eb80d
  Jee Jee Li authored Sep 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bb3eb80d