"examples/backends/vllm/deploy/agg_router.yaml" did not exist on "22e6c96f715177c776421c90e9415a7dbc4f661a"
-
Kuntai Du authored
This PR provides initial support for single-node disaggregated prefill in 1P1D scenario. Signed-off-by:
KuntaiDu <kuntai@uchicago.edu> Co-authored-by:
ApostaC <yihua98@uchicago.edu> Co-authored-by:
YaoJiayi <120040070@link.cuhk.edu.cn>
0590ec3f
