lib/runtime/src/component/endpoint.rs · 1954fcfa09825e13d140fb98a9ad3d113bf66bdd · OpenDAS / dynamo · GitLab

Find file Blame History Permalink

feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e

Hongkuan Zhou authored Aug 05, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

36c4ef5e

endpoint.rs 5.18 KB