Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
7df6bb18
Commit
7df6bb18
authored
Mar 14, 2025
by
Ryan McCormick
Committed by
GitHub
Mar 14, 2025
Browse files
fix: Add missing binaries back into container build (#152)
parent
cd14a1c5
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
11 additions
and
5 deletions
+11
-5
container/Dockerfile.tensorrt_llm
container/Dockerfile.tensorrt_llm
+6
-4
container/Dockerfile.vllm
container/Dockerfile.vllm
+5
-1
No files found.
container/Dockerfile.tensorrt_llm
View file @
7df6bb18
...
@@ -85,10 +85,12 @@ COPY components /workspace/components
...
@@ -85,10 +85,12 @@ COPY components /workspace/components
COPY launch /workspace/launch
COPY launch /workspace/launch
# TODO: Tanmay Add LLMAPI-based feature flag once the engine is ready.
# TODO: Tanmay Add LLMAPI-based feature flag once the engine is ready.
RUN cargo build --release --locked --features python && \
RUN cargo build --release --locked --features
mistralrs,sglang,
python && \
cargo doc --no-deps && \
cargo doc --no-deps && \
cp target/release/dynamo-run /usr/local/bin/ && \
cp target/release/dynamo-run /usr/local/bin && \
cp target/release/llmctl /usr/local/bin/
cp target/release/http /usr/local/bin && \
cp target/release/llmctl /usr/local/bin && \
cp target/release/metrics /usr/local/bin
COPY deploy/dynamo/sdk /workspace/deploy/dynamo/sdk
COPY deploy/dynamo/sdk /workspace/deploy/dynamo/sdk
...
@@ -125,4 +127,4 @@ COPY . /workspace
...
@@ -125,4 +127,4 @@ COPY . /workspace
# FIXME: May want a modification with dynamo banner on entry
# FIXME: May want a modification with dynamo banner on entry
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
CMD []
CMD []
\ No newline at end of file
container/Dockerfile.vllm
View file @
7df6bb18
...
@@ -224,7 +224,11 @@ ARG CARGO_BUILD_JOBS
...
@@ -224,7 +224,11 @@ ARG CARGO_BUILD_JOBS
ENV CARGO_TARGET_DIR=/workspace/target
ENV CARGO_TARGET_DIR=/workspace/target
RUN cargo build --release --locked --features mistralrs,sglang,vllm,python && \
RUN cargo build --release --locked --features mistralrs,sglang,vllm,python && \
cargo doc --no-deps
cargo doc --no-deps && \
cp target/release/dynamo-run /usr/local/bin && \
cp target/release/http /usr/local/bin && \
cp target/release/llmctl /usr/local/bin && \
cp target/release/metrics /usr/local/bin
COPY deploy/dynamo/sdk /workspace/deploy/dynamo/sdk
COPY deploy/dynamo/sdk /workspace/deploy/dynamo/sdk
# Build dynamo wheel
# Build dynamo wheel
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment