examples/python_rs/llm/vllm/monolith/worker.py · 0439d3b51d8b7e2577a623e491b857e7d4ff90c2 · OpenDAS / dynamo

feat: use vllm out of process engine · 60a73634

ptarasiewiczNV authored Feb 20, 2025


Signed-off-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Piotr Marcinkiewicz <piotrm@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

60a73634

worker.py 2.94 KB

Replace worker.py