Commits · 0fa939e2d154d42e9722e51d0d004eabfc0b5e6f · OpenDAS / vllm_cscc

24 Apr, 2025 2 commits
- Improve configs - `LoRAConfig` + `PromptAdapterConfig` (#16980) · 0fa939e2
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0fa939e2
- Simplify `TokenizerGroup` (#16790) · 0a05ed57
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0a05ed57
17 Apr, 2025 1 commit
- [V1][Perf] Faster incremental detokenization (#15137) · 05fcd1b4
  Nick Hill authored Apr 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  05fcd1b4
15 Apr, 2025 2 commits
- [Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546) · fdcb850f
  Angky William authored Apr 15, 2025
```
Signed-off-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
Co-authored-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
```
  fdcb850f
- [CI/Build] Fix LoRA OOM (#16624) · 1575c170
  Jee Jee Li authored Apr 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1575c170
14 Apr, 2025 1 commit
- [Bugfix] Multi-modal caches not acting like LRU caches (#16593) · aa29841e
  Cyrus Leung authored Apr 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa29841e
09 Apr, 2025 1 commit
- [CI/Build] Fix CI LoRA failure (#16270) · 86c3369e
  Jee Jee Li authored Apr 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  86c3369e
02 Apr, 2025 1 commit
- [CI/Build] Further clean up LoRA tests (#15920) · 4203926f
  Jee Jee Li authored Apr 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4203926f
01 Apr, 2025 2 commits
- [CI/Build] Clean up LoRA tests (#15867) · dfa82e2a
  Jee Jee Li authored Apr 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dfa82e2a
- [Misc] Enable V1 LoRA by default (#15320) · 79455cf4
  Varun Sundar Rabindranath authored Apr 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  79455cf4
27 Mar, 2025 1 commit

[misc] LoRA: Remove unused long context test data (#15558) · 8095341a

Varun Sundar Rabindranath authored Mar 26, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

8095341a

26 Mar, 2025 1 commit

[CI/Build] LoRA: Delete long context tests (#15503) · ff38f0a3

Varun Sundar Rabindranath authored Mar 25, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

ff38f0a3

22 Mar, 2025 1 commit
- [Bugfix] LoRA V0 - Fix case where `max_num_seqs` is between cudagraph capture sizes (#15308) · 8a8b30ea
  Varun Sundar Rabindranath authored Mar 22, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  8a8b30ea
21 Mar, 2025 2 commits
- [V1] Avoid redundant input processing in n>1 case (#14985) · da6ea29f
  Nick Hill authored Mar 20, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da6ea29f
- [CI/Build] LoRA : make add_lora_test safer (#15181) · 0cfe7d38
  Varun Sundar Rabindranath authored Mar 20, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  0cfe7d38
18 Mar, 2025 1 commit

[Kernels] LoRA - Retire SGMV and BGMV Kernels (#14685) · 400d483e

Varun Sundar Rabindranath authored Mar 18, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

400d483e

17 Mar, 2025 1 commit

[Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) · 2bb0e1a7

vllmellm authored Mar 17, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2bb0e1a7

15 Mar, 2025 2 commits

[CI/Build] Delete LoRA bias test (#14849) · e0fdfa16
Jee Jee Li authored Mar 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
e0fdfa16

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

14 Mar, 2025 1 commit

[Kernel] LoRA - Enable CUDAGraphs for V1 (#14626) · 0b1cfa61

Varun Sundar Rabindranath authored Mar 13, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

0b1cfa61

13 Mar, 2025 1 commit
- [CI/Build] Delete ultravox LoRA test (#14730) · bd44b812
  Jee Jee Li authored Mar 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bd44b812
12 Mar, 2025 1 commit

[CPU] Upgrade CPU backend to torch-2.6 (#13381) · ff47aab0

Li, Jiang authored Mar 12, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

ff47aab0

10 Mar, 2025 1 commit

[V1] LoRA - Add triton kernels for V1 (#13096) · 5ff0d325

Varun Sundar Rabindranath authored Mar 10, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

5ff0d325

07 Mar, 2025 2 commits
- [Bugfix] Further clean up LoRA test (#14422) · 12c29a88
  Jee Jee Li authored Mar 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  12c29a88
- [Bugfix] Fix JambaForCausalLM LoRA (#14370) · ddd1ef66
  Jee Jee Li authored Mar 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ddd1ef66
06 Mar, 2025 1 commit

[V1] LoRA - Enable more V1 tests (#14315) · 3dbd2d81

Varun Sundar Rabindranath authored Mar 05, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

3dbd2d81

03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 1 commit
- [Model] Add LoRA support for TransformersModel (#13770) · cc5e8f6d
  Jee Jee Li authored Mar 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  cc5e8f6d
26 Feb, 2025 1 commit
- [Misc] Improve LoRA spelling (#13831) · 5157338e
  Jee Jee Li authored Feb 26, 2025
  
  5157338e
25 Feb, 2025 2 commits
- [CI/Build] Fix V1 LoRA failure (#13767) · 37b6cb49
  Jee Jee Li authored Feb 25, 2025
  
  37b6cb49
- [Core] LoRA V1 - Add add/pin/list/remove_lora functions (#13705) · 03f48b3d
  Varun Sundar Rabindranath authored Feb 25, 2025
  
  03f48b3d
22 Feb, 2025 1 commit
- [Misc] Reduce LoRA-related static variable (#13166) · 105b8ce4
  Jee Jee Li authored Feb 22, 2025
  
  105b8ce4
20 Feb, 2025 1 commit
- [Misc] Qwen2.5 VL support LoRA (#13261) · 512368e3
  Jee Jee Li authored Feb 20, 2025
  
  512368e3
19 Feb, 2025 1 commit
- [V1][Core] Generic mechanism for handling engine utility (#13060) · caf7ff44
  Nick Hill authored Feb 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  caf7ff44
14 Feb, 2025 1 commit

[V1] LoRA - Enable Serving Usecase (#12883) · cbc40128

Varun Sundar Rabindranath authored Feb 14, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

cbc40128

12 Feb, 2025 1 commit
- [Misc] Delete unused LoRA modules (#13151) · 82cabf53
  Jee Jee Li authored Feb 13, 2025
  
  82cabf53
11 Feb, 2025 1 commit

[Misc] LoRA - Refactor Punica ops tests (#12970) · 78a141d7

Varun Sundar Rabindranath authored Feb 11, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

78a141d7

06 Feb, 2025 3 commits
- [V1] LoRA Support (#10957) · 467a96a5
  Varun Sundar Rabindranath authored Feb 06, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  467a96a5
- [Bugfix] Fix the test_ultravox.py's license (#12806) · 56534cd5
  Lu Fang authored Feb 05, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  56534cd5
- [Model] LoRA Support for Ultravox model (#11253) · d88506dd
  Sumit Vij authored Feb 05, 2025
  
  d88506dd