lib/bindings/python/rust/llm/local_model.rs · 1c39e4835c623f06f3e1a8b3c0c1d2c23e4ecf20 · OpenDAS / dynamo

feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483

Sean SH Choi authored Dec 17, 2025


Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

1c39e483

local_model.rs 4.45 KB

Replace local_model.rs