Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
00730fc6
Unverified
Commit
00730fc6
authored
Apr 16, 2025
by
ptarasiewiczNV
Committed by
GitHub
Apr 16, 2025
Browse files
feat: bump vLLM version to v0.8.4 (#690)
parent
48733546
Changes
4
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
5410 additions
and
224 deletions
+5410
-224
container/Dockerfile.vllm
container/Dockerfile.vllm
+6
-6
container/deps/vllm/tests/test_patch_install.py
container/deps/vllm/tests/test_patch_install.py
+1
-1
container/deps/vllm/vllm_v0.7.2-dynamo-kv-disagg-patch.patch
container/deps/vllm/vllm_v0.7.2-dynamo-kv-disagg-patch.patch
+756
-217
container/deps/vllm/vllm_v0.8.4-dynamo-kv-disagg-patch.patch
container/deps/vllm/vllm_v0.8.4-dynamo-kv-disagg-patch.patch
+4647
-0
No files found.
container/Dockerfile.vllm
View file @
00730fc6
...
@@ -181,16 +181,12 @@ RUN mkdir /opt/dynamo && \
...
@@ -181,16 +181,12 @@ RUN mkdir /opt/dynamo && \
ENV VIRTUAL_ENV=/opt/dynamo/venv
ENV VIRTUAL_ENV=/opt/dynamo/venv
ENV PATH="${VIRTUAL_ENV}/bin:${PATH}"
ENV PATH="${VIRTUAL_ENV}/bin:${PATH}"
# Common dependencies
RUN --mount=type=bind,source=./container/deps/requirements.txt,target=/tmp/requirements.txt \
uv pip install --requirement /tmp/requirements.txt
# Install patched vllm - keep this early in Dockerfile to avoid
# Install patched vllm - keep this early in Dockerfile to avoid
# rebuilds from unrelated source code changes
# rebuilds from unrelated source code changes
ARG VLLM_REF="0.
7.2
"
ARG VLLM_REF="0.
8.4
"
ARG VLLM_PATCH="vllm_v${VLLM_REF}-dynamo-kv-disagg-patch.patch"
ARG VLLM_PATCH="vllm_v${VLLM_REF}-dynamo-kv-disagg-patch.patch"
ARG VLLM_PATCHED_PACKAGE_NAME="ai_dynamo_vllm"
ARG VLLM_PATCHED_PACKAGE_NAME="ai_dynamo_vllm"
ARG VLLM_PATCHED_PACKAGE_VERSION="0.
7.2.post1
"
ARG VLLM_PATCHED_PACKAGE_VERSION="0.
8.4
"
RUN --mount=type=bind,source=./container/deps/,target=/tmp/deps \
RUN --mount=type=bind,source=./container/deps/,target=/tmp/deps \
mkdir /tmp/vllm && \
mkdir /tmp/vllm && \
uv pip install pip wheel && \
uv pip install pip wheel && \
...
@@ -211,6 +207,10 @@ RUN --mount=type=bind,source=./container/deps/,target=/tmp/deps \
...
@@ -211,6 +207,10 @@ RUN --mount=type=bind,source=./container/deps/,target=/tmp/deps \
wheel pack . --dest-dir /workspace/dist && \
wheel pack . --dest-dir /workspace/dist && \
uv pip install /workspace/dist/${VLLM_PATCHED_PACKAGE_NAME}-*.whl
uv pip install /workspace/dist/${VLLM_PATCHED_PACKAGE_NAME}-*.whl
# Common dependencies
RUN --mount=type=bind,source=./container/deps/requirements.txt,target=/tmp/requirements.txt \
uv pip install --requirement /tmp/requirements.txt
# Install test dependencies
# Install test dependencies
RUN --mount=type=bind,source=./container/deps/requirements.test.txt,target=/tmp/requirements.txt \
RUN --mount=type=bind,source=./container/deps/requirements.test.txt,target=/tmp/requirements.txt \
uv pip install --requirement /tmp/requirements.txt
uv pip install --requirement /tmp/requirements.txt
...
...
container/deps/vllm/tests/test_patch_install.py
View file @
00730fc6
...
@@ -27,4 +27,4 @@ pytestmark = pytest.mark.pre_merge
...
@@ -27,4 +27,4 @@ pytestmark = pytest.mark.pre_merge
@
pytest
.
mark
.
skipif
(
vllm
is
None
,
reason
=
"Skipping vllm tests, vllm not installed"
)
@
pytest
.
mark
.
skipif
(
vllm
is
None
,
reason
=
"Skipping vllm tests, vllm not installed"
)
def
test_version
():
def
test_version
():
# Verify that the image has the patched version of vllm
# Verify that the image has the patched version of vllm
assert
vllm
.
__version__
.
endswith
(
"0.
7.2
"
)
# type: ignore
assert
vllm
.
__version__
.
endswith
(
"0.
8.4
"
)
# type: ignore
container/deps/vllm/vllm_v0.7.2-dynamo-kv-disagg-patch.patch
View file @
00730fc6
This diff is collapsed.
Click to expand it.
container/deps/vllm/vllm_v0.8.4-dynamo-kv-disagg-patch.patch
0 → 100644
View file @
00730fc6
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment