container/deps/vllm/vllm_v0.7.2-triton-kv-disagg-patch.patch · 60a7363417f1ec7eb6e60e9eee2a824e6e712b7b · OpenDAS / dynamo

feat: use vllm out of process engine · 60a73634

ptarasiewiczNV authored Feb 20, 2025


Signed-off-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

60a73634

vllm_v0.7.2-triton-kv-disagg-patch.patch 77.3 KB

Replace vllm_v0.7.2-triton-kv-disagg-patch.patch