Commits · c32e249a23169353ccc02d7c6099a8c90ca4bbf6 · OpenDAS / vllm_cscc

23 May, 2025 1 commit

[Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization... · c32e249a

Sanger Steel authored May 22, 2025


[Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization and deserialization (#17926)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>

c32e249a

22 May, 2025 1 commit
- [Bugfix] Fix LoRA test (#18518) · db5a29ba
  Jee Jee Li authored May 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db5a29ba
15 May, 2025 1 commit

fix: typos (#18151) · a9944aab

omahs authored May 15, 2025


Signed-off-by: omahs <73983677+omahs@users.noreply.github.com>

a9944aab

14 May, 2025 1 commit
- [Bugfix] Fix LoRA test (#18123) · 259127f8
  Jee Jee Li authored May 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  259127f8
11 May, 2025 1 commit
- [Bugfix]: v1 engine - consider lora adapters in allowed_token_ids (#17855) · 8132365b
  Ben Browning authored May 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  8132365b
07 May, 2025 2 commits
- [Hardware][TPU][V1] Multi-LoRA implementation for the V1 TPU backend (#14238) · c20ef40f
  Akshat Tripathi authored May 07, 2025
```
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  c20ef40f
- [Bugfix] Fix missing lora name mapping for lora without prefix (#17793) · f98e3075
  Isotr0py authored May 08, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f98e3075
27 Apr, 2025 1 commit

[Bugfix] Fix Lora Name Parsing (#17196) · 756848e7

Alex Brooks authored Apr 27, 2025


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

756848e7

24 Apr, 2025 2 commits
- Improve configs - `LoRAConfig` + `PromptAdapterConfig` (#16980) · 0fa939e2
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0fa939e2
- Simplify `TokenizerGroup` (#16790) · 0a05ed57
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0a05ed57
17 Apr, 2025 1 commit
- [V1][Perf] Faster incremental detokenization (#15137) · 05fcd1b4
  Nick Hill authored Apr 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  05fcd1b4
15 Apr, 2025 2 commits
- [Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546) · fdcb850f
  Angky William authored Apr 15, 2025
```
Signed-off-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
Co-authored-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
```
  fdcb850f
- [CI/Build] Fix LoRA OOM (#16624) · 1575c170
  Jee Jee Li authored Apr 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1575c170
14 Apr, 2025 1 commit
- [Bugfix] Multi-modal caches not acting like LRU caches (#16593) · aa29841e
  Cyrus Leung authored Apr 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa29841e
09 Apr, 2025 1 commit
- [CI/Build] Fix CI LoRA failure (#16270) · 86c3369e
  Jee Jee Li authored Apr 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  86c3369e
02 Apr, 2025 1 commit
- [CI/Build] Further clean up LoRA tests (#15920) · 4203926f
  Jee Jee Li authored Apr 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4203926f
01 Apr, 2025 2 commits
- [CI/Build] Clean up LoRA tests (#15867) · dfa82e2a
  Jee Jee Li authored Apr 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dfa82e2a
- [Misc] Enable V1 LoRA by default (#15320) · 79455cf4
  Varun Sundar Rabindranath authored Apr 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  79455cf4
27 Mar, 2025 1 commit

[misc] LoRA: Remove unused long context test data (#15558) · 8095341a

Varun Sundar Rabindranath authored Mar 26, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

8095341a

26 Mar, 2025 1 commit

[CI/Build] LoRA: Delete long context tests (#15503) · ff38f0a3

Varun Sundar Rabindranath authored Mar 25, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

ff38f0a3

22 Mar, 2025 1 commit
- [Bugfix] LoRA V0 - Fix case where `max_num_seqs` is between cudagraph capture sizes (#15308) · 8a8b30ea
  Varun Sundar Rabindranath authored Mar 22, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  8a8b30ea
21 Mar, 2025 2 commits
- [V1] Avoid redundant input processing in n>1 case (#14985) · da6ea29f
  Nick Hill authored Mar 20, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da6ea29f
- [CI/Build] LoRA : make add_lora_test safer (#15181) · 0cfe7d38
  Varun Sundar Rabindranath authored Mar 20, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  0cfe7d38
18 Mar, 2025 1 commit

[Kernels] LoRA - Retire SGMV and BGMV Kernels (#14685) · 400d483e

Varun Sundar Rabindranath authored Mar 18, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

400d483e

17 Mar, 2025 1 commit

[Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) · 2bb0e1a7

vllmellm authored Mar 17, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2bb0e1a7

15 Mar, 2025 2 commits

[CI/Build] Delete LoRA bias test (#14849) · e0fdfa16
Jee Jee Li authored Mar 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
e0fdfa16

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

14 Mar, 2025 1 commit

[Kernel] LoRA - Enable CUDAGraphs for V1 (#14626) · 0b1cfa61

Varun Sundar Rabindranath authored Mar 13, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

0b1cfa61

13 Mar, 2025 1 commit
- [CI/Build] Delete ultravox LoRA test (#14730) · bd44b812
  Jee Jee Li authored Mar 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bd44b812
12 Mar, 2025 1 commit

[CPU] Upgrade CPU backend to torch-2.6 (#13381) · ff47aab0

Li, Jiang authored Mar 12, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

ff47aab0

10 Mar, 2025 1 commit

[V1] LoRA - Add triton kernels for V1 (#13096) · 5ff0d325

Varun Sundar Rabindranath authored Mar 10, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

5ff0d325

07 Mar, 2025 2 commits
- [Bugfix] Further clean up LoRA test (#14422) · 12c29a88
  Jee Jee Li authored Mar 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  12c29a88
- [Bugfix] Fix JambaForCausalLM LoRA (#14370) · ddd1ef66
  Jee Jee Li authored Mar 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ddd1ef66
06 Mar, 2025 1 commit

[V1] LoRA - Enable more V1 tests (#14315) · 3dbd2d81

Varun Sundar Rabindranath authored Mar 05, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

3dbd2d81

03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 1 commit
- [Model] Add LoRA support for TransformersModel (#13770) · cc5e8f6d
  Jee Jee Li authored Mar 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  cc5e8f6d
26 Feb, 2025 1 commit
- [Misc] Improve LoRA spelling (#13831) · 5157338e
  Jee Jee Li authored Feb 26, 2025
  
  5157338e
25 Feb, 2025 2 commits
- [CI/Build] Fix V1 LoRA failure (#13767) · 37b6cb49
  Jee Jee Li authored Feb 25, 2025
  
  37b6cb49
- [Core] LoRA V1 - Add add/pin/list/remove_lora functions (#13705) · 03f48b3d
  Varun Sundar Rabindranath authored Feb 25, 2025
  
  03f48b3d
22 Feb, 2025 1 commit
- [Misc] Reduce LoRA-related static variable (#13166) · 105b8ce4
  Jee Jee Li authored Feb 22, 2025
  
  105b8ce4