Commits · f256ebe4df6757d76f1f1642d7e110268a2f8190 · OpenDAS / vllm_cscc

20 Jan, 2025 1 commit
- [Bugfix] Fix num_heads value for simple connector when tp enabled (#12074) · df450aa5
  shangmingc authored Jan 20, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  df450aa5
08 Jan, 2025 1 commit
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
29 Dec, 2024 1 commit
- [Misc] KV cache transfer connector registry (#11481) · faef77c0
  Kuntai Du authored Dec 29, 2024
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  faef77c0
15 Dec, 2024 1 commit
- [Core] Support disaggregated prefill with Mooncake Transfer Engine (#10884) · d263bd9d
  shangmingc authored Dec 16, 2024
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d263bd9d
12 Dec, 2024 1 commit
- [Bugfix] Fix value unpack error of simple connector for KVCache transfer. (#11058) · db6c264a
  shangmingc authored Dec 13, 2024
```
Signed-off-by: ShangmingCai <csmthu@gmail.com>
```
  db6c264a
02 Dec, 2024 1 commit

[Core] Implement disagg prefill by StatelessProcessGroup (#10502) · 0590ec3f

Kuntai Du authored Dec 01, 2024



This PR provides initial support for single-node disaggregated prefill in 1P1D scenario.
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: YaoJiayi <120040070@link.cuhk.edu.cn>

0590ec3f