Commits · bde38c11df0ea066a740efe9b77fff5418be45df · OpenDAS / vllm_cscc

09 Jan, 2026 1 commit

fix lora moe sharding when rank < max_lora_rank (#31994) · bde38c11

gnovack authored Jan 08, 2026


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

bde38c11

08 Jan, 2026 1 commit

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c

Lucas Wilkinson authored Jan 08, 2026


[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

6cdf015c

05 Jan, 2026 1 commit
- [Platform] Deprecate seed_everything (#31659) · bb4337b3
  wangxiyuan authored Jan 05, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  bb4337b3
31 Dec, 2025 1 commit
- [Fix] Align fused moe lora_b shape with peft (#31534) · ecd49ce7
  B-201 authored Dec 31, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
  ecd49ce7
30 Dec, 2025 1 commit
- Add Loraconfig parameter to get_punica_wrapper function (#31408) · f84bf7d7
  ZT-AIA authored Dec 30, 2025
```
Signed-off-by: ZT-AIA <1028681969@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f84bf7d7
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

16 Dec, 2025 2 commits
- Fix instantiation of `HfHubHTTPError` in LoRA test (#30768) · af506fd7
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af506fd7
- [Bugfix] Fix RequestOutput miss lora_request (#30636) · 0e391e75
  Jee Jee Li authored Dec 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0e391e75
09 Dec, 2025 1 commit
- Lora MoE Align Improvements (#29257) · ea657f20
  gnovack authored Dec 08, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  ea657f20
08 Dec, 2025 1 commit
- [Misc] Split the LoRA code (#30253) · 67312cad
  Jee Jee Li authored Dec 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  67312cad
07 Dec, 2025 3 commits
- [CI/Build]Temporary workaround for test_default_mm_loras timeout (#30202) · b0f4866a
  Jee Jee Li authored Dec 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b0f4866a
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
02 Dec, 2025 1 commit
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

27 Nov, 2025 1 commit
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
24 Nov, 2025 2 commits
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
- [LoRA] Optimize 3D MoE logic (#29222) · 1073ba68
  Jee Jee Li authored Nov 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1073ba68
21 Nov, 2025 2 commits
- [Bugfix] Fix default MM LoRA alignment for single str prompts (#29140) · b4734b95
  Alex Brooks authored Nov 20, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  b4734b95
- [LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
  Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9875be64
19 Nov, 2025 1 commit
- add support for --fully-sharded-loras in fused_moe (#28761) · d69062c6
  gnovack authored Nov 19, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d69062c6
10 Nov, 2025 1 commit
- [CI] lora/test_mixtral.py : Add additional expected outputs due to flakiness (#28322) · 6b2b9fd9
  Varun Sundar Rabindranath authored Nov 09, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  6b2b9fd9
04 Nov, 2025 1 commit
- Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435) · 2ec401bc
  yugong333 authored Nov 04, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2ec401bc
03 Nov, 2025 2 commits
- Early exit for MoE LoRA kernels (#27131) · 294c805f
  gnovack authored Nov 03, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  294c805f
- [CI/Build] Remove the flaky gpt-oss lora test (#27966) · 32257297
  Jee Jee Li authored Nov 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  32257297
31 Oct, 2025 1 commit
- [CI/Build] Add gpt-oss LoRA test (#27870) · 0384aa71
  Jee Jee Li authored Oct 31, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0384aa71
30 Oct, 2025 1 commit
- [CI Failure] fix test_default_mm_loras (#27795) · c7d2a554
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c7d2a554
27 Oct, 2025 2 commits

[Kernel] Enable moe LoRA kernel support FP16 (#27468) · f4e81540
Jee Jee Li authored Oct 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
f4e81540

[Kernel] Adding split_K implementation for fused_moe_lora (#27291) · 9932ed6a

Danielle Robinson authored Oct 27, 2025


Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9932ed6a

22 Oct, 2025 1 commit
- Bugfix - pass 'max_num_tokens_padded' into 'moe_lora_align_block_size' (#27311) · 8e4ca4d1
  gnovack authored Oct 22, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8e4ca4d1
21 Oct, 2025 2 commits

Update PyTorch to 2.9.0+cu129 (#24994) · becb7de4
Huy Do authored Oct 21, 2025
```
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
becb7de4

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60

20 Oct, 2025 1 commit

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143

19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
16 Oct, 2025 1 commit
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
15 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
14 Oct, 2025 1 commit
- [CI/Build] Cleanup LoRA test (#26752) · fdd32750
  Jee Jee Li authored Oct 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdd32750
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit

Remove LoRA bias support (#25807) · ab196ede

Ashwin Phadke authored Oct 10, 2025


Signed-off-by: Ashwin Phadke <ashwinphadke12@rediffmail.com>
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ab196ede

06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382