Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
d23679eb
Unverified
Commit
d23679eb
authored
Sep 23, 2024
by
Yan Ma
Committed by
GitHub
Sep 22, 2024
Browse files
[Bugfix] fix docker build for xpu (#8652)
parent
57a0702e
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
6 additions
and
14 deletions
+6
-14
Dockerfile.xpu
Dockerfile.xpu
+1
-9
docs/source/getting_started/xpu-installation.rst
docs/source/getting_started/xpu-installation.rst
+3
-3
requirements-xpu.txt
requirements-xpu.txt
+2
-2
No files found.
Dockerfile.xpu
View file @
d23679eb
...
...
@@ -10,19 +10,11 @@ RUN wget -O- https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRO
RUN apt-get update -y \
&& apt-get install -y curl libicu70 lsb-release git wget vim numactl python3 python3-pip ffmpeg libsm6 libxext6 libgl1
RUN git clone https://github.com/intel/pti-gpu && \
cd pti-gpu/sdk && \
mkdir build && \
cd build && \
cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_TOOLCHAIN_FILE=../cmake/toolchains/icpx_toolchain.cmake -DBUILD_TESTING=OFF .. && \
make -j && \
cmake --install . --config Release --prefix "/usr/local"
COPY ./ /workspace/vllm
WORKDIR /workspace/vllm
RUN pip install -v -r requirements-xpu.txt
RUN pip install -v -r requirements-xpu.txt
--extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
RUN VLLM_TARGET_DEVICE=xpu python3 setup.py install
...
...
docs/source/getting_started/xpu-installation.rst
View file @
d23679eb
...
...
@@ -17,8 +17,8 @@ Requirements
------------
* OS: Linux
* Supported Hardware: Intel Data Center GPU
(
Intel ARC GPU
WIP)
* OneAPI requirements: oneAPI 2024.
1
* Supported Hardware: Intel Data Center GPU
,
Intel ARC GPU
* OneAPI requirements: oneAPI 2024.
2
.. _xpu_backend_quick_start_dockerfile:
...
...
@@ -40,7 +40,7 @@ Quick start using Dockerfile
Build from source
-----------------
- First, install required driver and intel OneAPI 2024.
1
or later.
- First, install required driver and intel OneAPI 2024.
2
or later.
- Second, install Python packages for vLLM XPU backend building:
...
...
requirements-xpu.txt
View file @
d23679eb
...
...
@@ -3,10 +3,10 @@
setuptools < 70.0.0 # IPEX's torch have some dependency. to be removed.
ray >= 2.9
# Following pkgs retrieved from https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
torch == 2.3.1+cxx11.abi
intel-extension-for-pytorch == 2.3.110+xpu
oneccl_bind_pt == 2.3.100+xpu
triton-xpu == 3.0.0b2
--extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment