-
GuanLuo authored
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695) Signed-off-by:Guan Luo <41310872+GuanLuo@users.noreply.github.com>
90d74637
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>