examples/backends/sglang/launch/disagg_router.sh · 1c39e4835c623f06f3e1a8b3c0c1d2c23e4ecf20 · OpenDAS / dynamo

feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483

Sean SH Choi authored Dec 17, 2025


Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

1c39e483

disagg_router.sh 4.47 KB

Replace disagg_router.sh