Commits · 3408e471597e7a36ca79fab5fc849f4fb5576df8 · OpenDAS / vllm_cscc

17 Apr, 2025 1 commit

[P/D][V1] KV Connector API V1 (#15960) · 3408e471

Yihua Cheng authored Apr 17, 2025


Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>

3408e471

11 Apr, 2025 2 commits
- [Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779) · 34b2cf3b
  Tomasz Zielinski authored Apr 11, 2025
```
Signed-off-by: Tomasz Zielinski <tomasz.zielinski@intel.com>
```
  34b2cf3b
- [Core][LoRA][1/N] Add LoRA for EncoderDecoderModelRunner (#15990) · f7030df3
  Jee Jee Li authored Apr 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f7030df3
10 Apr, 2025 1 commit
- [misc] use tqdm.auto where appropriate (#16290) · 82eb61dd
  Benjamin Kitor authored Apr 09, 2025
```
Signed-off-by: Benjamin Kitor <bkitor@gigaio.com>
```
  82eb61dd
02 Apr, 2025 3 commits
- [CPU][Bugfix] Using custom allreduce for CPU backend (#15934) · 550b2801
  Li, Jiang authored Apr 02, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  550b2801
- [core] Add tags parameter to wake_up() (#15500) · ddb94c26
  Eric Tang authored Apr 02, 2025
```
Signed-off-by: Eric <erictang000@gmail.com>
```
  ddb94c26
- [Bugfix] Fix cache block size calculation for CPU MLA (#15848) · 2edc87b1
  Thien Tran authored Apr 02, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  2edc87b1
31 Mar, 2025 1 commit
- fix: change GB to GiB in logging close #14979 (#15807) · 2de41182
  yihong authored Apr 01, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2de41182
27 Mar, 2025 1 commit
- [TPU] support disabling xla compilation cache (#15567) · e74ff409
  Chengji Yao authored Mar 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  e74ff409
26 Mar, 2025 1 commit

[misc] LoRA - Skip LoRA kernels when not required (#15152) · 6c663dfd

Varun Sundar Rabindranath authored Mar 25, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

6c663dfd

25 Mar, 2025 1 commit
- [Kernel][CPU] CPU MLA (#14744) · 4f044b1d
  Thien Tran authored Mar 25, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  4f044b1d
24 Mar, 2025 1 commit
- [Hardware][Gaudi][Feature] Enable Dynamic MoE for Mixtral (#12303) · 5eeadc26
  liuzhenwei authored Mar 25, 2025
```
Signed-off-by: zhenwei <zhenweiliu@habana.ai>
```
  5eeadc26
22 Mar, 2025 1 commit
- Remove openvino support in favor of external plugin (#15339) · b877031d
  Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b877031d
16 Mar, 2025 2 commits
- Revert "[Bugfix] Limit profiling run sequence length by max_model_len (#14785) (#14892) · f6137adb
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6137adb
- [Bugfix] Limit profiling run sequence length by max_model_len (#14785) · d30aa7e9
  Kyle Sayers authored Mar 16, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d30aa7e9
15 Mar, 2025 3 commits
- [Attention] Get rid of mla cache alignment (#14842) · 5952d8ab
  Lucas Wilkinson authored Mar 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5952d8ab
- [CPU] Support FP8 KV cache (#14741) · a2ae4965
  Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a2ae4965
- [Bugfix] Fix torch_xla in V0 which can't handle None seed introduced … (#14844) · dd344e03
  yarongmu-google authored Mar 14, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  dd344e03
08 Mar, 2025 1 commit
- [Bugfix] Make the deviceprofiler include LoRA memory. (#14469) · b8b0ccbd
  Jee Jee Li authored Mar 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b8b0ccbd
07 Mar, 2025 1 commit
- Fix missing `kv_caches` and `attn_metadata` in `OpenVINOCausalLM` (#14271) · f7a6bd0f
  Harry Mellor authored Mar 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f7a6bd0f
06 Mar, 2025 1 commit
- [RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185) · 151b08e0
  youkaichao authored Mar 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  151b08e0
04 Mar, 2025 2 commits
- [TPU][Profiler] Support start_profile/stop_profile in TPU worker (#13988) · beebf474
  Siyuan Liu authored Mar 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  beebf474
- Use math.prod instead of np.prod for trivial ops (#14142) · 66233af7
  Zhanwen Chen authored Mar 04, 2025
  
  66233af7
02 Mar, 2025 1 commit
- [Misc] Accurately capture the time of loading weights (#14063) · 82fbeae9
  Jun Duan authored Mar 01, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  82fbeae9
28 Feb, 2025 1 commit
- [Hardware][Intel-Gaudi] Regional compilation support (#13213) · b91660dd
  Kacper Pietkun authored Feb 28, 2025
  
  b91660dd
27 Feb, 2025 2 commits
- [Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626) · 9804145c
  Benjamin Chislett authored Feb 27, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  9804145c
- [PP] Correct cache size check (#13873) · 4b1d141f
  Yang Zheng authored Feb 27, 2025
```
Signed-off-by: Yang Zheng <zhengy.gator@gmail.com>
```
  4b1d141f
26 Feb, 2025 2 commits
- [Bugfix] Do not crash V0 engine on input errors (#13101) · 3f808cc0
  Joe Runde authored Feb 26, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  3f808cc0
- [Misc] Improve LoRA spelling (#13831) · 5157338e
  Jee Jee Li authored Feb 26, 2025
  
  5157338e
25 Feb, 2025 2 commits
- [Misc] set single whitespace between log sentences (#13771) · 51010a18
  cjackal authored Feb 25, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  51010a18
- Remove unused kwargs from model definitions (#13555) · cdc1fa12
  Harry Mellor authored Feb 25, 2025
  
  cdc1fa12
23 Feb, 2025 1 commit
- [v1] torchrun compatibility (#13642) · eb24dc4a
  youkaichao authored Feb 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb24dc4a
22 Feb, 2025 3 commits
- [core] set up data parallel communication (#13591) · 3e472d88
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3e472d88
- [Misc] Reduce LoRA-related static variable (#13166) · 105b8ce4
  Jee Jee Li authored Feb 22, 2025
  
  105b8ce4
- [Misc] Capture and log the time of loading weights (#13666) · 68d535ef
  Jun Duan authored Feb 22, 2025
  
  68d535ef
20 Feb, 2025 1 commit
- fix neuron performance issue (#13589) · 6a417b86
  ajayvohra2005 authored Feb 20, 2025
  
  6a417b86
19 Feb, 2025 3 commits
- [Model][Speculative Decoding] DeepSeek MTP spec decode (#12755) · f525c0be
  Lucia Fang authored Feb 19, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  f525c0be
- use device param in load_model method (#13037) · fdc5df6f
  Zhe Zhang authored Feb 19, 2025
  
  fdc5df6f
- [Hardware][Gaudi][Feature] Support Contiguous Cache Fetch (#12139) · d0a7a276
  Yu-Zhou authored Feb 19, 2025
```
Signed-off-by: yuzhou <yuzhou@habana.ai>
Signed-off-by: zhouyu5 <yu.zhou@intel.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  d0a7a276
13 Feb, 2025 1 commit

[V1][Core] Add worker_base for v1 worker (#12816) · 2092a6fa

Aoyu authored Feb 13, 2025


Signed-off-by: Aoyu <aoyuzhan@amazon.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Aoyu <aoyuzhan@amazon.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

2092a6fa