Commits · 04e50aba33109d9f60c609a0f100ebb413ffabad · OpenDAS / dynamo

"examples/python_rs/llm/vllm/routerless/worker.py" did not exist on "7567620fcd974cc32b276d2057bcceefb0c43ca4"

01 Feb, 2025 2 commits

docs: Add Llama 70B benchmark reproduction and results · 04e50aba

ptarasiewiczNV authored Feb 01, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

04e50aba

feat(llm): adding initial TRTLLM disaggregation support · deb6c7e8

ishandhanani authored Feb 01, 2025


Co-authored-by: nnshah1 <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

deb6c7e8