llm/rust/triton-llm/src/protocols/common/llm_backend.rs · ffc6dde1f0c6a45ac2ed72e91139949992c9c55d · OpenDAS / dynamo

feat: OpenAI compatible http service (#123) · ffc6dde1

Ryan Olson authored Feb 10, 2025


Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

ffc6dde1

llm_backend.rs 4.07 KB

Replace llm_backend.rs