components/backends/vllm/deploy/disagg_planner.yaml · 9ddb3efdbe1fc5a9872206d115c2050d497bbf23 · OpenDAS / dynamo · GitLab

Find file Blame History Permalink

feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e

Hongkuan Zhou authored Aug 05, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

36c4ef5e

disagg_planner.yaml 6.7 KB