Commits · 8ff4a9956693450a37843bde88934ebcea440402 · OpenDAS / vllm_cscc

07 Jan, 2026 1 commit

[Refactor][TPU] Remove torch_xla path and use tpu-inference (#30808) · e7596371

weiyu authored Jan 07, 2026


Signed-off-by: Wei-Yu Lin <weiyulin@google.com>
Signed-off-by: weiyu <62784299+weiyu0824@users.noreply.github.com>

e7596371

06 Jan, 2026 1 commit
- [LoRA]Disable linear LoRA kernel PDL (#31777) · cbd4690a
  Jee Jee Li authored Jan 06, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  cbd4690a
05 Jan, 2026 3 commits
- pin lora_b moe weights on cpu (#31317) · c77a993c
  gnovack authored Jan 05, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  c77a993c
- [LoRA] LoRA PDL improvement (#31660) · d5503ca7
  Jee Jee Li authored Jan 05, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d5503ca7
- [Bugfix] Fix AttributeError: 'Stream' object has no attribute 'dp_size' (#31663) · f099cd55
  Jee Jee Li authored Jan 05, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f099cd55
31 Dec, 2025 1 commit
- [Fix] Align fused moe lora_b shape with peft (#31534) · ecd49ce7
  B-201 authored Dec 31, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
  ecd49ce7
30 Dec, 2025 1 commit
- Add Loraconfig parameter to get_punica_wrapper function (#31408) · f84bf7d7
  ZT-AIA authored Dec 30, 2025
```
Signed-off-by: ZT-AIA <1028681969@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f84bf7d7
26 Dec, 2025 2 commits

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

[Misc] Fix Qwen2-MoE shared_expert_gate (#31339) · c3666f56
Jee Jee Li authored Dec 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
c3666f56

24 Dec, 2025 1 commit
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
23 Dec, 2025 2 commits
- [Bugfix] Fix MoE LoRA bin/pt loading (#31161) · 27c6c2f9
  Jee Jee Li authored Dec 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  27c6c2f9
- [Feature] Batch invariant: Lora (#30097) · a37328fc
  liuquan authored Dec 23, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
```
  a37328fc
18 Dec, 2025 1 commit

fused_moe_lora PDL improvements (#30716) · 5a3adf58

gnovack authored Dec 17, 2025


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

5a3adf58

16 Dec, 2025 1 commit
- [Docs][API] Remove warning about LoRARequest being internal-only (#30774) · 66c3537e
  Mark McLoughlin authored Dec 16, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  66c3537e
09 Dec, 2025 1 commit
- [Misc] Fix safetensors import for safe_open (#30300) · e4605d22
  Yongtao Huang authored Dec 09, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  e4605d22
08 Dec, 2025 2 commits
- [Misc] Split the LoRA code (#30253) · 67312cad
  Jee Jee Li authored Dec 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  67312cad
- [LoRA] Reduce the loading time of MoE LoRA (#30243) · 80433e22
  Jee Jee Li authored Dec 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  80433e22
04 Dec, 2025 2 commits
- Fix broken multiline assert in `LoRAModelManager.register_module` (#30032) · dd97e047
  Yongtao Huang authored Dec 04, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  dd97e047
- [Bugfix] Fix adapter_enabled IMA (#29977) · dd38ba3a
  Jee Jee Li authored Dec 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dd38ba3a
30 Nov, 2025 1 commit

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091

Xin Yang authored Nov 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a491b091

29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

28 Nov, 2025 2 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
27 Nov, 2025 3 commits
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
- [Bugfix] Fix getting device for MoE LoRA (#29475) · c069086b
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c069086b
24 Nov, 2025 1 commit
- [LoRA] Optimize 3D MoE logic (#29222) · 1073ba68
  Jee Jee Li authored Nov 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1073ba68
22 Nov, 2025 1 commit
- [LoRA] Cleanup FusedMoEWithLoRA (#29187) · 1489902b
  Jee Jee Li authored Nov 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1489902b
21 Nov, 2025 1 commit
- [LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
  Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9875be64
20 Nov, 2025 1 commit
- [Bugfix] Fix precision loss in LoRA-wrapped RowParallelLinear by fusing bias into GEMM (#28972) · 0cca9b4d
  prashanth058 authored Nov 19, 2025
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
  0cca9b4d
19 Nov, 2025 1 commit
- add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
  gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d69062c6
18 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28863) · 083cf326
  Didier Durand authored Nov 18, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  083cf326
14 Nov, 2025 1 commit
- [Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
  Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f3cd7f7
13 Nov, 2025 1 commit
- [XPU] Support Triton path for LoRA operations on XPU (#28511) · dbbe0c75
  Fanli Lin authored Nov 13, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  dbbe0c75
11 Nov, 2025 2 commits
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
- Fix Fused MoE LoRA Triton kernel bug (#28450) · 7dbe6d81
  Chaojun Zhang authored Nov 11, 2025
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
```
  7dbe6d81
10 Nov, 2025 1 commit
- [Kernel] Optimization of the mm_k operator. (#28280) · 40e2eeeb
  caozuoba authored Nov 11, 2025
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  40e2eeeb
08 Nov, 2025 1 commit

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068) · d0c77920

Xiaohong (Sean) Chen authored Nov 07, 2025

Signed-off-by: Sean Chen <xiaohong_chen1991@hotmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>

d0c77920

07 Nov, 2025 1 commit
- [Kernel] LoRA triton kernels support PDL (#27402) · 21b82f4e
  Jee Jee Li authored Nov 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  21b82f4e
06 Nov, 2025 1 commit

[BugFix] Fix FusedMoELoRA + ModularKernel Integration (#28237) · ca6f755d

Varun Sundar Rabindranath authored Nov 06, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

ca6f755d