Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
9723d627
Unverified
Commit
9723d627
authored
May 28, 2025
by
Biswa Panda
Committed by
GitHub
May 28, 2025
Browse files
fix: planner shutdown fix replace kantuko with appropriate circus package (#1248)
parent
39462e1d
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
17 additions
and
1 deletion
+17
-1
container/Dockerfile.sglang
container/Dockerfile.sglang
+6
-0
container/Dockerfile.tensorrt_llm
container/Dockerfile.tensorrt_llm
+4
-0
container/Dockerfile.vllm
container/Dockerfile.vllm
+6
-0
pyproject.toml
pyproject.toml
+1
-1
No files found.
container/Dockerfile.sglang
View file @
9723d627
...
@@ -353,6 +353,9 @@ RUN mkdir -p /opt/dynamo/bindings/wheels && \
...
@@ -353,6 +353,9 @@ RUN mkdir -p /opt/dynamo/bindings/wheels && \
RUN uv pip install /workspace/dist/ai_dynamo_runtime*cp312*.whl && \
RUN uv pip install /workspace/dist/ai_dynamo_runtime*cp312*.whl && \
uv pip install /workspace/dist/ai_dynamo*any.whl
uv pip install /workspace/dist/ai_dynamo*any.whl
# TODO: remove kantoku as a transitive dependency
RUN uv pip uninstall kantoku circus && uv pip install circus==0.19.0
# Copy launch banner
# Copy launch banner
RUN --mount=type=bind,source=./container/launch_message.txt,target=/workspace/launch_message.txt \
RUN --mount=type=bind,source=./container/launch_message.txt,target=/workspace/launch_message.txt \
sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && \
sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && \
...
@@ -404,6 +407,9 @@ RUN uv pip install ai-dynamo[vllm] --find-links wheelhouse && \
...
@@ -404,6 +407,9 @@ RUN uv pip install ai-dynamo[vllm] --find-links wheelhouse && \
ln -sf $VIRTUAL_ENV/bin/* /usr/local/bin/ && \
ln -sf $VIRTUAL_ENV/bin/* /usr/local/bin/ && \
rm -r wheelhouse
rm -r wheelhouse
# TODO: remove kantoku as a transitive dependency
RUN uv pip uninstall kantoku circus && uv pip install circus==0.19.0
# Tell vllm to use the Dynamo LLM C API for KV Cache Routing
# Tell vllm to use the Dynamo LLM C API for KV Cache Routing
ENV VLLM_KV_CAPI_PATH="/opt/dynamo/bindings/lib/libdynamo_llm_capi.so"
ENV VLLM_KV_CAPI_PATH="/opt/dynamo/bindings/lib/libdynamo_llm_capi.so"
...
...
container/Dockerfile.tensorrt_llm
View file @
9723d627
...
@@ -330,6 +330,10 @@ RUN . /opt/dynamo/venv/bin/activate && \
...
@@ -330,6 +330,10 @@ RUN . /opt/dynamo/venv/bin/activate && \
uv pip install /workspace/dist/ai_dynamo_runtime*cp312*.whl && \
uv pip install /workspace/dist/ai_dynamo_runtime*cp312*.whl && \
uv pip install /workspace/dist/ai_dynamo*any.whl
uv pip install /workspace/dist/ai_dynamo*any.whl
# TODO: remove kantoku as a transitive dependency
RUN . /opt/dynamo/venv/bin/activate && \
uv pip uninstall kantoku circus && uv pip install circus==0.19.0
# Install dynamo.runtime and dynamo.llm wheels globally in container for tests
# Install dynamo.runtime and dynamo.llm wheels globally in container for tests
# TODO: In future, we may use a virtualenv for everything and remove this.
# TODO: In future, we may use a virtualenv for everything and remove this.
RUN pip install dist/ai_dynamo_runtime*cp312*.whl && \
RUN pip install dist/ai_dynamo_runtime*cp312*.whl && \
...
...
container/Dockerfile.vllm
View file @
9723d627
...
@@ -426,6 +426,9 @@ RUN mkdir -p /opt/dynamo/bindings/wheels && \
...
@@ -426,6 +426,9 @@ RUN mkdir -p /opt/dynamo/bindings/wheels && \
RUN uv pip install /workspace/dist/ai_dynamo_runtime*cp312*.whl && \
RUN uv pip install /workspace/dist/ai_dynamo_runtime*cp312*.whl && \
uv pip install /workspace/dist/ai_dynamo*any.whl
uv pip install /workspace/dist/ai_dynamo*any.whl
# TODO: remove kantoku as a transitive dependency
RUN uv pip uninstall kantoku circus && uv pip install circus==0.19.0
# Copy launch banner
# Copy launch banner
RUN --mount=type=bind,source=./container/launch_message.txt,target=/workspace/launch_message.txt \
RUN --mount=type=bind,source=./container/launch_message.txt,target=/workspace/launch_message.txt \
sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && \
sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && \
...
@@ -477,6 +480,9 @@ RUN uv pip install ai-dynamo[vllm] --find-links wheelhouse && \
...
@@ -477,6 +480,9 @@ RUN uv pip install ai-dynamo[vllm] --find-links wheelhouse && \
ln -sf $VIRTUAL_ENV/bin/* /usr/local/bin/ && \
ln -sf $VIRTUAL_ENV/bin/* /usr/local/bin/ && \
rm -r wheelhouse
rm -r wheelhouse
# TODO: remove kantoku as a transitive dependency
RUN uv pip uninstall kantoku circus && uv pip install circus==0.19.0
# Tell vllm to use the Dynamo LLM C API for KV Cache Routing
# Tell vllm to use the Dynamo LLM C API for KV Cache Routing
ENV VLLM_KV_CAPI_PATH="/opt/dynamo/bindings/lib/libdynamo_llm_capi.so"
ENV VLLM_KV_CAPI_PATH="/opt/dynamo/bindings/lib/libdynamo_llm_capi.so"
...
...
pyproject.toml
View file @
9723d627
...
@@ -33,7 +33,7 @@ dependencies = [
...
@@ -33,7 +33,7 @@ dependencies = [
"fastapi==0.115.6"
,
"fastapi==0.115.6"
,
"distro"
,
"distro"
,
"typer"
,
"typer"
,
"circus
>
=0.1
7
.0"
,
"circus
=
=0.1
9
.0"
,
"click<8.2.0"
,
"click<8.2.0"
,
]
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment