-
Tzu-Ling Kan authored
feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481) Signed-off-by:tzulingk <tzulingk@nvidia.com>
daa4fb04
feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481)
Signed-off-by: tzulingk <tzulingk@nvidia.com>