Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
2c5ebec0
Unverified
Commit
2c5ebec0
authored
Jul 07, 2025
by
Liangliang Ma
Committed by
GitHub
Jul 07, 2025
Browse files
[XPU][CI] add v1/core test in xpu hardware ci (#20537)
Signed-off-by:
Ma, Liangliang
<
liangliang.ma@intel.com
>
parent
2e610deb
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
6 additions
and
8 deletions
+6
-8
.buildkite/scripts/hardware_ci/run-xpu-test.sh
.buildkite/scripts/hardware_ci/run-xpu-test.sh
+4
-2
docker/Dockerfile.xpu
docker/Dockerfile.xpu
+1
-1
vllm/platforms/xpu.py
vllm/platforms/xpu.py
+1
-5
No files found.
.buildkite/scripts/hardware_ci/run-xpu-test.sh
View file @
2c5ebec0
...
@@ -11,8 +11,8 @@ container_name="xpu_${BUILDKITE_COMMIT}_$(tr -dc A-Za-z0-9 < /dev/urandom | head
...
@@ -11,8 +11,8 @@ container_name="xpu_${BUILDKITE_COMMIT}_$(tr -dc A-Za-z0-9 < /dev/urandom | head
docker build
-t
${
image_name
}
-f
docker/Dockerfile.xpu
.
docker build
-t
${
image_name
}
-f
docker/Dockerfile.xpu
.
# Setup cleanup
# Setup cleanup
remove_docker_container
()
{
remove_docker_container
()
{
docker
rm
-f
"
${
container_name
}
"
||
true
;
docker
rm
-f
"
${
container_name
}
"
||
true
;
docker image
rm
-f
"
${
image_name
}
"
||
true
;
docker image
rm
-f
"
${
image_name
}
"
||
true
;
docker system prune
-f
||
true
;
docker system prune
-f
||
true
;
}
}
...
@@ -27,4 +27,6 @@ docker run \
...
@@ -27,4 +27,6 @@ docker run \
"
${
image_name
}
"
\
"
${
image_name
}
"
\
sh
-c
'
sh
-c
'
VLLM_USE_V1=1 python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --block-size 64 --enforce-eager
VLLM_USE_V1=1 python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --block-size 64 --enforce-eager
cd tests
pytest -v -s v1/core
'
'
docker/Dockerfile.xpu
View file @
2c5ebec0
...
@@ -47,7 +47,7 @@ FROM vllm-base AS vllm-openai
...
@@ -47,7 +47,7 @@ FROM vllm-base AS vllm-openai
# install additional dependencies for openai api server
# install additional dependencies for openai api server
RUN --mount=type=cache,target=/root/.cache/pip \
RUN --mount=type=cache,target=/root/.cache/pip \
pip install accelerate hf_transfer 'modelscope!=1.15.0'
pip install accelerate hf_transfer
pytest
'modelscope!=1.15.0'
ENV VLLM_USAGE_SOURCE production-docker-image \
ENV VLLM_USAGE_SOURCE production-docker-image \
TRITON_XPU_PROFILE 1
TRITON_XPU_PROFILE 1
...
...
vllm/platforms/xpu.py
View file @
2c5ebec0
...
@@ -93,10 +93,6 @@ class XPUPlatform(Platform):
...
@@ -93,10 +93,6 @@ class XPUPlatform(Platform):
"mode."
)
"mode."
)
model_config
.
enforce_eager
=
True
model_config
.
enforce_eager
=
True
if
vllm_config
.
speculative_config
is
not
None
:
raise
NotImplementedError
(
"XPU does not support speculative decoding"
)
if
vllm_config
.
device_config
is
not
None
:
if
vllm_config
.
device_config
is
not
None
:
assert
vllm_config
.
device_config
.
device_type
==
"xpu"
assert
vllm_config
.
device_config
.
device_type
==
"xpu"
...
@@ -181,4 +177,4 @@ class XPUPlatform(Platform):
...
@@ -181,4 +177,4 @@ class XPUPlatform(Platform):
@
classmethod
@
classmethod
def
device_count
(
cls
)
->
int
:
def
device_count
(
cls
)
->
int
:
return
torch
.
xpu
.
device_count
()
return
torch
.
xpu
.
device_count
()
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment