Skip to content

GitLab

Commit 5bf82e48 authored by ptarasiewiczNV's avatar ptarasiewiczNV Committed by GitHub
Browse files

fix: Add nixl to runtime container (#191) 


Co-authored-by: default avatarhongkuanz <hongkuanz@nvidia.com>
parent 635d98ce
Show whitespace changes
Inline Side-by-side
Showing with 5 additions and 0 deletions
container/Dockerfile.vllm
View file @ 5bf82e48
...@@ -307,6 +307,11 @@ ENV VIRTUAL_ENV=/opt/dynamo/venv ...@@ -307,6 +307,11 @@ ENV VIRTUAL_ENV=/opt/dynamo/venv
RUN rm /bin/sh && ln -s /bin/bash /bin/sh RUN rm /bin/sh && ln -s /bin/bash /bin/sh
# Copy NIXL
COPY --from=dev /usr/local/nixl /usr/local/nixl
ENV LD_LIBRARY_PATH=/usr/local/nixl/lib/x86_64-linux-gnu/:$LD_LIBRARY_PATH
ENV PYTHONPATH=/usr/local/nixl/lib/python3/dist-packages/:/opt/nixl/test/python/:$PYTHONPATH
# Setup the python environment # Setup the python environment
COPY --from=ghcr.io/astral-sh/uv:latest /uv /uvx /bin/ COPY --from=ghcr.io/astral-sh/uv:latest /uv /uvx /bin/
RUN uv venv $VIRTUAL_ENV --python 3.12 && \ RUN uv venv $VIRTUAL_ENV --python 3.12 && \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment