lib/llm/src/kv_router.rs · 1c39e4835c623f06f3e1a8b3c0c1d2c23e4ecf20 · OpenDAS / dynamo

feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483

Sean SH Choi authored Dec 17, 2025


Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

1c39e483

kv_router.rs 33.5 KB

Replace kv_router.rs