Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
4f4f6bb7
Commit
4f4f6bb7
authored
Mar 11, 2025
by
Tanmay Verma
Committed by
GitHub
Mar 11, 2025
Browse files
fix: Fix build regression in TRTLLM container with th rename. (#103)
parent
5bcdb734
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
5 deletions
+5
-5
container/Dockerfile.tensorrt_llm
container/Dockerfile.tensorrt_llm
+5
-5
No files found.
container/Dockerfile.tensorrt_llm
View file @
4f4f6bb7
...
@@ -101,15 +101,15 @@ RUN mkdir /opt/dynamo && \
...
@@ -101,15 +101,15 @@ RUN mkdir /opt/dynamo && \
uv venv /opt/dynamo/venv --python 3.12 && \
uv venv /opt/dynamo/venv --python 3.12 && \
source /opt/dynamo/venv/bin/activate && \
source /opt/dynamo/venv/bin/activate && \
uv build --wheel --out-dir /workspace/dist && \
uv build --wheel --out-dir /workspace/dist && \
uv pip install /workspace/dist/dynamo*cp312*.whl && \
uv pip install /workspace/dist/
ai_
dynamo*cp312*.whl && \
cd /workspace/deploy/dynamo/sdk && \
cd /workspace/deploy/dynamo/sdk && \
uv build --wheel --out-dir /workspace/dist && \
uv build --wheel --out-dir /workspace/dist && \
uv pip install /workspace/dist/dynamo_sdk*any.whl
uv pip install /workspace/dist/
ai_
dynamo_sdk*any.whl
# Package the bindings
# Package the bindings
RUN mkdir -p /opt/dynamo/bindings/wheels && \
RUN mkdir -p /opt/dynamo/bindings/wheels && \
mkdir /opt/dynamo/bindings/lib && \
mkdir /opt/dynamo/bindings/lib && \
cp dist/dynamo*cp312*.whl /opt/dynamo/bindings/wheels/. && \
cp dist/
ai_
dynamo*cp312*.whl /opt/dynamo/bindings/wheels/. && \
cp lib/bindings/c/target/release/libdynamo_llm_capi.so /opt/dynamo/bindings/lib/. && \
cp lib/bindings/c/target/release/libdynamo_llm_capi.so /opt/dynamo/bindings/lib/. && \
cp -r lib/bindings/c/include /opt/dynamo/bindings/.
cp -r lib/bindings/c/include /opt/dynamo/bindings/.
...
@@ -117,8 +117,8 @@ RUN mkdir -p /opt/dynamo/bindings/wheels && \
...
@@ -117,8 +117,8 @@ RUN mkdir -p /opt/dynamo/bindings/wheels && \
# currently run without virtual environment activated.
# currently run without virtual environment activated.
# TODO: In future, we may use a virtualenv for everything and remove this.
# TODO: In future, we may use a virtualenv for everything and remove this.
RUN cd /opt/dynamo/bindings/wheels && \
RUN cd /opt/dynamo/bindings/wheels && \
pip install dynamo*cp312*.whl && \
pip install
ai_
dynamo*cp312*.whl && \
pip install /workspace/dist/dynamo_sdk*any.whl
pip install /workspace/dist/
ai_
dynamo_sdk*any.whl
# Tell TRTLLM worker to use the Dynamo LLM C API for KV Cache Routing
# Tell TRTLLM worker to use the Dynamo LLM C API for KV Cache Routing
ENV DYNAMO_KV_CAPI_PATH="/opt/dynamo/bindings/lib/libdynamo_llm_capi.so"
ENV DYNAMO_KV_CAPI_PATH="/opt/dynamo/bindings/lib/libdynamo_llm_capi.so"
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment