lib/llm/src/grpc/service/kserve.rs · 50dfd3af7fc977b8c4c140c32485ed0fc4b162a6 · OpenDAS / dynamo

feat: tensor type for generic inference. (#2746) · 6ba64c31

GuanLuo authored Sep 24, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6ba64c31

kserve.rs 23 KB

Replace kserve.rs