Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
761ff073
Commit
761ff073
authored
Mar 16, 2025
by
Anant Sharma
Committed by
GitHub
Mar 16, 2025
Browse files
chore: update version for patched vLLM wheel (#193)
parent
9ae7dde7
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
10 additions
and
6 deletions
+10
-6
container/Dockerfile.vllm
container/Dockerfile.vllm
+9
-5
container/deps/vllm/tests/test_patch_install.py
container/deps/vllm/tests/test_patch_install.py
+1
-1
No files found.
container/Dockerfile.vllm
View file @
761ff073
...
...
@@ -191,17 +191,21 @@ RUN --mount=type=bind,source=./container/deps/requirements.txt,target=/tmp/requi
# Install patched vllm - keep this early in Dockerfile to avoid
# rebuilds from unrelated source code changes
ARG VLLM_REF="v0.7.2"
ARG VLLM_PATCH="vllm_${VLLM_REF}-dynamo-kv-disagg-patch.patch"
ARG VLLM_REF="0.7.2"
ARG VLLM_PATCH="vllm_v${VLLM_REF}-dynamo-kv-disagg-patch.patch"
ARG VLLM_VERSION_PATCH_SUFFIX="dynamo"
RUN --mount=type=bind,source=./container/deps/,target=/tmp/deps \
mkdir /tmp/vllm && \
uv pip install pip wheel && \
python -m pip download --only-binary=:all: --no-deps --dest /tmp/vllm vllm==${VLLM_REF} && \
python -m pip download --only-binary=:all: --no-deps --dest /tmp/vllm vllm==
v
${VLLM_REF} && \
cd /tmp/vllm && \
wheel unpack *.whl && \
cd vllm-
*
/ && \
cd vllm-
${VLLM_REF}
/ && \
patch -p1 < /tmp/deps/vllm/${VLLM_PATCH} && \
sed -i "s/__version__ = version = '\(.*\)'/__version__ = version = '\1.dynamo_patch'/g; s/__version_tuple__ = version_tuple = (\(.*\))/__version_tuple__ = version_tuple = (\1, 'dynamo_patch')/g" vllm/_version.py && \
sed -i "s/__version__ = version = '\(.*\)'/__version__ = version = '\1+${VLLM_VERSION_PATCH_SUFFIX}'/g; s/__version_tuple__ = version_tuple = (\(.*\))/__version_tuple__ = version_tuple = (\1, '${VLLM_VERSION_PATCH_SUFFIX}')/g" vllm/_version.py && \
mv vllm-${VLLM_REF}.dist-info vllm-${VLLM_REF}+${VLLM_VERSION_PATCH_SUFFIX}.dist-info && \
sed -i "s/${VLLM_REF}/${VLLM_REF}+${VLLM_VERSION_PATCH_SUFFIX}/g" vllm-${VLLM_REF}+${VLLM_VERSION_PATCH_SUFFIX}.dist-info/METADATA && \
sed -i "s/vllm-${VLLM_REF}/vllm-${VLLM_REF}+${VLLM_VERSION_PATCH_SUFFIX}/g" vllm-${VLLM_REF}+${VLLM_VERSION_PATCH_SUFFIX}.dist-info/RECORD && \
mkdir -p /workspace/dist && \
wheel pack . --dest-dir /workspace/dist && \
uv pip install /workspace/dist/vllm-*.whl
...
...
container/deps/vllm/tests/test_patch_install.py
View file @
761ff073
...
...
@@ -27,4 +27,4 @@ pytestmark = pytest.mark.pre_merge
@
pytest
.
mark
.
skipif
(
vllm
is
None
,
reason
=
"Skipping vllm tests, vllm not installed"
)
def
test_version
():
# Verify that the image has the patched version of vllm
assert
vllm
.
__version__
.
endswith
(
"dynamo
_patch
"
)
# type: ignore
assert
vllm
.
__version__
.
endswith
(
"
+
dynamo"
)
# type: ignore
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment