Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
aff584fa
Unverified
Commit
aff584fa
authored
May 06, 2025
by
Qiaolin Yu
Committed by
GitHub
May 06, 2025
Browse files
Fix sgl-kernel build on aarch64 platforms (#6062)
parent
6f566147
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
14 additions
and
3 deletions
+14
-3
sgl-kernel/build.sh
sgl-kernel/build.sh
+14
-3
No files found.
sgl-kernel/build.sh
View file @
aff584fa
...
@@ -7,12 +7,23 @@ PYTHON_ROOT_PATH=/opt/python/cp${PYTHON_VERSION//.}-cp${PYTHON_VERSION//.}
...
@@ -7,12 +7,23 @@ PYTHON_ROOT_PATH=/opt/python/cp${PYTHON_VERSION//.}-cp${PYTHON_VERSION//.}
ARCH
=
$(
uname
-i
)
ARCH
=
$(
uname
-i
)
echo
"ARCH:
$ARCH
"
echo
"ARCH:
$ARCH
"
if
[
${
ARCH
}
=
"aarch64"
]
;
then
LIBCUDA_ARCH
=
"sbsa"
BUILDER_NAME
=
"pytorch/manylinuxaarch64-builder"
else
LIBCUDA_ARCH
=
${
ARCH
}
if
[
${
CUDA_VERSION
}
=
"12.8"
]
;
then
BUILDER_NAME
=
"pytorch/manylinux2_28-builder"
else
BUILDER_NAME
=
"pytorch/manylinux-builder"
fi
fi
if
[
${
CUDA_VERSION
}
=
"12.8"
]
;
then
if
[
${
CUDA_VERSION
}
=
"12.8"
]
;
then
DOCKER_IMAGE
=
"
pytorch/manylinux2_28-builder
:cuda
${
CUDA_VERSION
}
"
DOCKER_IMAGE
=
"
${
BUILDER_NAME
}
:cuda
${
CUDA_VERSION
}
"
TORCH_INSTALL
=
"pip install --no-cache-dir --pre torch --index-url https://download.pytorch.org/whl/nightly/cu
${
CUDA_VERSION
//.
}
"
TORCH_INSTALL
=
"pip install --no-cache-dir --pre torch --index-url https://download.pytorch.org/whl/nightly/cu
${
CUDA_VERSION
//.
}
"
else
else
DOCKER_IMAGE
=
"
pytorch/manylinux-builder
:cuda
${
CUDA_VERSION
}
"
DOCKER_IMAGE
=
"
${
BUILDER_NAME
}
:cuda
${
CUDA_VERSION
}
"
TORCH_INSTALL
=
"pip install --no-cache-dir torch==2.6.0 --index-url https://download.pytorch.org/whl/cu
${
CUDA_VERSION
//.
}
"
TORCH_INSTALL
=
"pip install --no-cache-dir torch==2.6.0 --index-url https://download.pytorch.org/whl/cu
${
CUDA_VERSION
//.
}
"
fi
fi
...
@@ -39,7 +50,7 @@ docker run --rm \
...
@@ -39,7 +50,7 @@ docker run --rm \
export TORCH_CUDA_ARCH_LIST='7.5 8.0 8.9 9.0+PTX' &&
\
export TORCH_CUDA_ARCH_LIST='7.5 8.0 8.9 9.0+PTX' &&
\
export CUDA_VERSION=
${
CUDA_VERSION
}
&&
\
export CUDA_VERSION=
${
CUDA_VERSION
}
&&
\
mkdir -p /usr/lib/
${
ARCH
}
-linux-gnu/ &&
\
mkdir -p /usr/lib/
${
ARCH
}
-linux-gnu/ &&
\
ln -s /usr/local/cuda-
${
CUDA_VERSION
}
/targets/
x86_64
-linux/lib/stubs/libcuda.so /usr/lib/
${
ARCH
}
-linux-gnu/libcuda.so &&
\
ln -s /usr/local/cuda-
${
CUDA_VERSION
}
/targets/
${
LIBCUDA_ARCH
}
-linux/lib/stubs/libcuda.so /usr/lib/
${
ARCH
}
-linux-gnu/libcuda.so &&
\
cd /sgl-kernel &&
\
cd /sgl-kernel &&
\
ls -la
${
PYTHON_ROOT_PATH
}
/lib/python
${
PYTHON_VERSION
}
/site-packages/wheel/ &&
\
ls -la
${
PYTHON_ROOT_PATH
}
/lib/python
${
PYTHON_VERSION
}
/site-packages/wheel/ &&
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment