Commits · ca871491edb0fba11fe9aa94300bd8d282fa29e1 · OpenDAS / vllm_cscc

09 Dec, 2024 1 commit
- [Misc][LoRA] Abstract PunicaWrapper (#10955) · ca871491
  Jee Jee Li authored Dec 10, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ca871491
07 Dec, 2024 1 commit
- [Misc][LoRA] Refactor and clean MergedQKVParallelLinearWithLora implementation (#10958) · b26b4cd0
  Isotr0py authored Dec 07, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b26b4cd0
05 Dec, 2024 1 commit
- [Misc][LoRA] Clean up the function interface of Punica (#10917) · 571da8fc
  Jee Jee Li authored Dec 05, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  571da8fc
03 Dec, 2024 1 commit
- [Bugfix] Fix QKVParallelLinearWithShardedLora bias bug (#10844) · a4cf2561
  Jee Jee Li authored Dec 03, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a4cf2561
02 Dec, 2024 1 commit
- [Misc][LoRA] Move the implementation of lora bias to punica.py (#10829) · b45f0d79
  Jee Jee Li authored Dec 03, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b45f0d79
24 Nov, 2024 1 commit

[Bugfix] Fix LoRA weight sharding (#10450) · 1700c543

Jee Jee Li authored Nov 24, 2024


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1700c543

21 Nov, 2024 1 commit
- [Kernel] Register punica ops directly (#10522) · 2385b60d
  Jee Jee Li authored Nov 22, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2385b60d
18 Nov, 2024 1 commit
- [Kernel] Explicitly specify other value in tl.load calls (#9014) · c2170a5b
  Angus Wang authored Nov 18, 2024
```
Signed-off-by: Angus Wang <wangjadehao@gmail.com>
```
  c2170a5b
15 Nov, 2024 1 commit
- [Bugfix] Fix fully sharded LoRA bug (#10352) · 1d65ec7e
  Jee Jee Li authored Nov 15, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1d65ec7e
12 Nov, 2024 2 commits
- [LoRA] Adds support for bias in LoRA (#5733) · 8a06428c
  Umesh authored Nov 12, 2024
```
Signed-off-by: Umesh Deshpande <udeshpa@us.ibm.com>
Co-authored-by: Umesh Deshpande <udeshpa@us.ibm.com>
```
  8a06428c
- [Misc][LoRA] Replace hardcoded cuda device with configurable argument (#10223) · 7f5edb59
  Jee Jee Li authored Nov 12, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7f5edb59
11 Nov, 2024 1 commit
- [LoRA][Kernel] Remove the unused libentry module (#10214) · 36e4acd0
  Jee Jee Li authored Nov 11, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  36e4acd0
06 Nov, 2024 1 commit
- [CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
  Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  21063c11
29 Oct, 2024 1 commit
- [Model][LoRA]LoRA support added for Qwen (#9622) · 7a4df5f2
  Jee Jee Li authored Oct 29, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7a4df5f2
12 Oct, 2024 1 commit
- [Bugfix]Fix MiniCPM's LoRA bug (#9286) · 250e26a6
  Jee Jee Li authored Oct 13, 2024
  
  250e26a6
11 Oct, 2024 1 commit
- [Misc][LoRA] Support loading LoRA weights for target_modules in reg format (#9275) · 36ea7907
  Jee Jee Li authored Oct 11, 2024
  
  36ea7907
09 Oct, 2024 1 commit
- [Bugfix] Fix lora loading for Compressed Tensors in #9120 (#9179) · 21906a6f
  Ahmad Fahadh Ilyas authored Oct 09, 2024
  
  21906a6f
04 Oct, 2024 1 commit
- [Misc] Move registry to its own file (#9064) · 0e36fd49
  Cyrus Leung authored Oct 04, 2024
  
  0e36fd49
29 Sep, 2024 1 commit
- [Model][LoRA]LoRA support added for MiniCPMV2.5 (#7199) · 3d49776b
  Jee Jee Li authored Sep 29, 2024
  
  3d49776b
23 Sep, 2024 1 commit
- [Kernel][LoRA] Add assertion for punica sgmv kernels (#7585) · 9b0e3ec9
  Jee Jee Li authored Sep 24, 2024
  
  9b0e3ec9
20 Sep, 2024 1 commit
- [Core] Support Lora lineage and base model metadata management (#6315) · 260d40b5
  Jiaxin Shan authored Sep 19, 2024
  
  260d40b5
06 Sep, 2024 2 commits
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
- [Core] Support load and unload LoRA in api server (#6566) · db3bf7c9
  Jiaxin Shan authored Sep 05, 2024
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db3bf7c9
28 Aug, 2024 1 commit
- [Bugfix] Make torch registration of punica ops optional (#7970) · 3cdfe1f3
  bnellnm authored Aug 28, 2024
  
  3cdfe1f3
20 Aug, 2024 1 commit
- [Intel GPU] fix xpu not support punica kernel (which use torch.library.custom_op) (#7685) · 6e4658c7
  Kunshang Ji authored Aug 21, 2024
  
  6e4658c7
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
16 Aug, 2024 1 commit
- [Kernel] register punica functions as torch ops (#7591) · 9f698563
  bnellnm authored Aug 16, 2024
  
  9f698563
09 Aug, 2024 1 commit
- [Speculative decoding] [Multi-Step] decouple should_modify_greedy_probs_inplace (#6971) · 57b7be0e
  William Lin authored Aug 08, 2024
  
  57b7be0e
08 Aug, 2024 1 commit
- [Bugfix] Fix LoRA with PP (#7292) · 6dffa4b0
  Murali Andoorveedu authored Aug 08, 2024
  
  6dffa4b0
06 Aug, 2024 1 commit
- [LoRA] Relax LoRA condition (#7146) · 9118217f
  Jee Jee Li authored Aug 06, 2024
  
  9118217f
05 Aug, 2024 1 commit
- [Bugfix] Specify device when loading LoRA and embedding tensors (#7129) · 89b8db6b
  Jacob Schein authored Aug 05, 2024
```
Co-authored-by: Jacob Schein <jacobschein@Jacobs-MacBook-Pro-2.local>
```
  89b8db6b
04 Aug, 2024 1 commit
- Clean up remaining Punica C information (#7027) · f80ab352
  Jee Jee Li authored Aug 05, 2024
  
  f80ab352
03 Aug, 2024 1 commit
- [LoRA] ReplicatedLinear support LoRA (#7081) · 99d7cabd
  Jee Jee Li authored Aug 03, 2024
  
  99d7cabd
01 Aug, 2024 1 commit
- [Kernel][RFC] Refactor the punica kernel based on Triton (#5036) · 7ecee343
  Jee Jee Li authored Aug 01, 2024
  
  7ecee343
27 Jul, 2024 1 commit
- [TPU] Support collective communications in XLA devices (#6813) · d09b94ca
  Woosuk Kwon authored Jul 26, 2024
  
  d09b94ca
22 Jul, 2024 1 commit
- [Core] Support dynamically loading Lora adapter from HuggingFace (#6234) · 42c7f66a
  Jiaxin Shan authored Jul 22, 2024
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  42c7f66a
09 Jul, 2024 1 commit

[CORE] Adding support for insertion of soft-tuned prompts (#4645) · 4d6ada94

Swapnil Parekh authored Jul 09, 2024


Co-authored-by: Swapnil Parekh <swapnilp@ibm.com>
Co-authored-by: Joe G <joseph.granados@h2o.ai>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

4d6ada94

03 Jul, 2024 1 commit
- [hardware][misc] introduce platform abstraction (#6080) · 482045ee
  youkaichao authored Jul 02, 2024
  
  482045ee
02 Jul, 2024 1 commit
- [CORE] Quantized lm-head Framework (#4442) · ee93f4f9
  Qubitium-ModelCloud authored Jul 03, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: ZX <zx@lbx.dev>
```
  ee93f4f9
01 Jul, 2024 1 commit
- [misc][cuda] use nvml to avoid accidentally cuda initialization (#6007) · 614aa512
  youkaichao authored Jun 30, 2024
  
  614aa512