Commits · b12e87f942eb7740c17ab546b964bc327afdda37 · OpenDAS / vllm_cscc

30 Dec, 2024 1 commit
- [platforms] enable platform plugins (#11602) · b12e87f9
  youkaichao authored Dec 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b12e87f9
29 Dec, 2024 1 commit
- [Misc] KV cache transfer connector registry (#11481) · faef77c0
  Kuntai Du authored Dec 29, 2024
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  faef77c0
15 Dec, 2024 1 commit
- [Core] Support disaggregated prefill with Mooncake Transfer Engine (#10884) · d263bd9d
  shangmingc authored Dec 16, 2024
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d263bd9d
12 Dec, 2024 2 commits
- [Bugfix] Fix value unpack error of simple connector for KVCache transfer. (#11058) · db6c264a
  shangmingc authored Dec 13, 2024
```
Signed-off-by: ShangmingCai <csmthu@gmail.com>
```
  db6c264a
- [core][distributed] initialization from StatelessProcessGroup (#10986) · 62de37a3
  youkaichao authored Dec 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  62de37a3
10 Dec, 2024 1 commit
- [V1] Multiprocessing Tensor Parallel Support for v1 (#9856) · 28b3a1c7
  Tyler Michael Smith authored Dec 10, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  28b3a1c7
03 Dec, 2024 1 commit
- [core][distributed] add pynccl broadcast (#10843) · 21fe7b48
  youkaichao authored Dec 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  21fe7b48
02 Dec, 2024 1 commit

[Core] Implement disagg prefill by StatelessProcessGroup (#10502) · 0590ec3f

Kuntai Du authored Dec 01, 2024



This PR provides initial support for single-node disaggregated prefill in 1P1D scenario.
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: YaoJiayi <120040070@link.cuhk.edu.cn>

0590ec3f

26 Nov, 2024 1 commit

custom allreduce + torch.compile (#10121) · 9a88f897

Sage Moore authored Nov 26, 2024


Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

9a88f897

23 Nov, 2024 1 commit
- [Misc] Add pynccl wrappers for all_gather and reduce_scatter (#9432) · 978b3974
  Tyler Michael Smith authored Nov 22, 2024
  
  978b3974
13 Nov, 2024 1 commit
- [core][distributed] use tcp store directly (#10275) · 0d4ea3fb
  youkaichao authored Nov 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0d4ea3fb
11 Nov, 2024 1 commit
- [core][distributed] add stateless process group (#10216) · e6de9784
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e6de9784
08 Nov, 2024 1 commit
- [Bugfix][XPU] Fix xpu tp by introducing XpuCommunicator (#10144) · f10797c0
  Yan Ma authored Nov 08, 2024
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  f10797c0
07 Nov, 2024 2 commits
- [Core][Distributed] Refactor ipc buffer init in CustomAllreduce (#10030) · 6192e9b8
  Hanzhi Zhou authored Nov 06, 2024
```
Signed-off-by: Hanzhi Zhou <hanzhi713@gmail.com>
```
  6192e9b8
- [core][distributed] add stateless_init_process_group (#10072) · 719c1ca4
  youkaichao authored Nov 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  719c1ca4
06 Nov, 2024 4 commits

[CI/Build] Drop Python 3.8 support (#10038) · 098f94de

Russell Bryant authored Nov 06, 2024


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

098f94de

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143) · a02a50e6

Konrad Zawora authored Nov 06, 2024


Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Signed-off-by: Bob Zhu <bob.zhu@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Sanju C Sudhakaran <scsudhakaran@habana.ai>
Co-authored-by: Michal Adamczyk <madamczyk@habana.ai>
Co-authored-by: Marceli Fylcek <mfylcek@habana.ai>
Co-authored-by: Himangshu Lahkar <49579433+hlahkar@users.noreply.github.com>
Co-authored-by: Vivek Goel <vgoel@habana.ai>
Co-authored-by: yuwenzho <yuwen.zhou@intel.com>
Co-authored-by: Dominika Olszewska <dolszewska@habana.ai>
Co-authored-by: barak goldberg <149692267+bgoldberg-habana@users.noreply.github.com>
Co-authored-by: Michal Szutenberg <37601244+szutenberg@users.noreply.github.com>
Co-authored-by: Jan Kaniecki <jkaniecki@habana.ai>
Co-authored-by: Agata Dobrzynie...