Commits · 8bddb735123204872788a8ffe117321de7550e6c · OpenDAS / vllm_cscc · GitLab

12 Jan, 2025 1 commit

[Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100) · 8bddb735

Akshat Tripathi authored Jan 12, 2025


Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

8bddb735

07 Jan, 2025 1 commit

[Kernel][LoRA]Punica prefill kernels fusion (#11234) · b2785579

Jee Jee Li authored Jan 07, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Zhonghua Deng <abatom@163.com>

b2785579

01 Jan, 2025 1 commit
- [Misc] Optimize Qwen2-VL LoRA test (#11663) · 11d8a091
  Jee Jee Li authored Jan 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  11d8a091
31 Dec, 2024 1 commit

[Misc][LoRA] Support Rank Stabilized LoRA (RSLoRA) (#6909) · 82c49d32

John Giorgi authored Dec 31, 2024


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

82c49d32

27 Dec, 2024 1 commit
- [MODEL] LoRA support for Jamba model (#11209) · 55509c21
  ErezSC42 authored Dec 27, 2024
```
Signed-off-by: Erez Schwartz <erezs@ai21.com>
```
  55509c21
26 Dec, 2024 1 commit
- [Misc][LoRA] Fix LoRA weight mapper (#11495) · aa25985b
  Jee Jee Li authored Dec 26, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  aa25985b
24 Dec, 2024 1 commit
- [Bugfix] Fix Qwen2-VL LoRA weight loading (#11430) · b1b1038f
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b1b1038f
22 Dec, 2024 1 commit
- [Bugfix] Fix fully sharded LoRAs with Mixtral (#11390) · f1d1bf62
  Jason T. Greene authored Dec 22, 2024
```
Signed-off-by: Jason Greene <jason.greene@redhat.com>
```
  f1d1bf62
18 Dec, 2024 1 commit
- [Bugfix] fix minicpmv test (#11304) · ca5f54a9
  Joe Runde authored Dec 18, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  ca5f54a9
11 Dec, 2024 1 commit
- [Misc] LoRA + Chunked Prefill (#9057) · d5c5154f
  Aurick Qiao authored Dec 10, 2024
  
  d5c5154f
10 Dec, 2024 1 commit
- [Misc][LoRA] Add PEFTHelper for LoRA (#11003) · d05f8867
  Jee Jee Li authored Dec 10, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d05f8867
09 Dec, 2024 1 commit
- [Misc][LoRA] Abstract PunicaWrapper (#10955) · ca871491
  Jee Jee Li authored Dec 10, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ca871491
05 Dec, 2024 1 commit
- [Misc][LoRA] Clean up the function interface of Punica (#10917) · 571da8fc
  Jee Jee Li authored Dec 05, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  571da8fc
04 Dec, 2024 1 commit
- [LoRA] Change lora_tokenizers capacity (#10796) · 01d079fd
  Xin Yang authored Dec 04, 2024
```
Signed-off-by: Xin Yang <xyang19@gmail.com>
```
  01d079fd
02 Dec, 2024 1 commit
- [Misc][LoRA] Move the implementation of lora bias to punica.py (#10829) · b45f0d79
  Jee Jee Li authored Dec 03, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b45f0d79
24 Nov, 2024 1 commit

[Bugfix] Fix LoRA weight sharding (#10450) · 1700c543

Jee Jee Li authored Nov 24, 2024


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1700c543

21 Nov, 2024 1 commit
- [Kernel] Register punica ops directly (#10522) · 2385b60d
  Jee Jee Li authored Nov 22, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2385b60d
12 Nov, 2024 2 commits
- [LoRA] Adds support for bias in LoRA (#5733) · 8a06428c
  Umesh authored Nov 12, 2024
```
Signed-off-by: Umesh Deshpande <udeshpa@us.ibm.com>
Co-authored-by: Umesh Deshpande <udeshpa@us.ibm.com>
```
  8a06428c
- [Misc][LoRA] Replace hardcoded cuda device with configurable argument (#10223) · 7f5edb59
  Jee Jee Li authored Nov 12, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7f5edb59
11 Nov, 2024 1 commit
- [LoRA][Kernel] Remove the unused libentry module (#10214) · 36e4acd0
  Jee Jee Li authored Nov 11, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  36e4acd0
04 Nov, 2024 1 commit
- [Bugfix][CI/Build][Hardware][AMD] Shard ID parameters in AMD tests running parallel jobs (#9279) · 5208dc7a
  hissu-hyvarinen authored Nov 04, 2024
```
Signed-off-by: Hissu Hyvarinen <hissu.hyvarinen@amd.com>
```
  5208dc7a
02 Nov, 2024 2 commits
- [3/N] model runner pass the whole config to model (#9958) · cea808f3
  youkaichao authored Nov 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  cea808f3
- [2/N] executor pass the complete config to worker/modelrunner (#9938) · e8937954
  youkaichao authored Nov 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  e8937954
29 Oct, 2024 1 commit
- [Hardware] using current_platform.seed_everything (#9785) · 622b7ab9
  wangshuai09 authored Oct 29, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  622b7ab9
28 Oct, 2024 1 commit
- [Hardware][ROCM] using current_platform.is_rocm (#9642) · 4e2d95e3
  wangshuai09 authored Oct 28, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  4e2d95e3
22 Oct, 2024 2 commits
- [CI/Build][LoRA] Temporarily fix long context failure issue (#9579) · a48e3ec0
  Jee Jee Li authored Oct 22, 2024
  
  a48e3ec0
- 🐛 Fixup more test failures from memory profiling (#9563) · ef7faad1
  Joe Runde authored Oct 21, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  ef7faad1
18 Oct, 2024 2 commits
- [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) · d11bf435
  Cody Yu authored Oct 18, 2024
  
  d11bf435
- [Model] Add user-configurable task for models that support both generation and embedding (#9424) · 051eaf6d
  Cyrus Leung authored Oct 19, 2024
  
  051eaf6d
16 Oct, 2024 1 commit
- [Misc] Standardize RoPE handling for Qwen2-VL (#9250) · 7e7eae33
  Cyrus Leung authored Oct 16, 2024
  
  7e7eae33
11 Oct, 2024 1 commit
- [Misc][LoRA] Support loading LoRA weights for target_modules in reg format (#9275) · 36ea7907
  Jee Jee Li authored Oct 11, 2024
  
  36ea7907
04 Oct, 2024 1 commit
- [Model] add a bunch of supported lora modules for mixtral (#9008) · 9ade8bbc
  Prashant Gupta authored Oct 04, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  9ade8bbc
29 Sep, 2024 2 commits
- [Model][LoRA]LoRA support added for MiniCPMV2.5 (#7199) · 3d49776b
  Jee Jee Li authored Sep 29, 2024
  
  3d49776b
- [CI/Build] Add test decorator for minimum GPU memory (#8925) · 26a68d5d
  Cyrus Leung authored Sep 29, 2024
  
  26a68d5d
26 Sep, 2024 1 commit
- [BugFix] Fix test breakages from transformers 4.45 upgrade (#8829) · 4b377d6f
  Nick Hill authored Sep 27, 2024
  
  4b377d6f
23 Sep, 2024 1 commit
- [Kernel][LoRA] Add assertion for punica sgmv kernels (#7585) · 9b0e3ec9
  Jee Jee Li authored Sep 24, 2024
  
  9b0e3ec9
18 Sep, 2024 2 commits
- [CI/Build] Update Ruff version (#8469) · 9d104b5b
  Aaron Pham authored Sep 18, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  9d104b5b
- [CI/Build] Avoid CUDA initialization (#8534) · 6ffa3f31
  Cyrus Leung authored Sep 18, 2024
  
  6ffa3f31
04 Sep, 2024 2 commits
- [CI] Change test input in Gemma LoRA test (#8163) · 561d6f80
  Woosuk Kwon authored Sep 04, 2024
  
  561d6f80
- [CI/Build][ROCm] Enabling LoRA tests on ROCm (#7369) · d1dec642
  alexeykondrat authored Sep 04, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  d1dec642