Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
7046e0fa
"torchvision/vscode:/vscode.git/clone" did not exist on "0c75d99d59bbc8e22e9dc40469c5b4ec1d742f03"
Unverified
Commit
7046e0fa
authored
Jun 12, 2025
by
Yineng Zhang
Committed by
GitHub
Jun 12, 2025
Browse files
feat: update blackwell setup (#7119)
parent
930746d9
Changes
6
Hide whitespace changes
Inline
Side-by-side
Showing
6 changed files
with
16 additions
and
8 deletions
+16
-8
docker/Dockerfile.blackwell
docker/Dockerfile.blackwell
+2
-2
sgl-kernel/CMakeLists.txt
sgl-kernel/CMakeLists.txt
+10
-2
sgl-kernel/pyproject.toml
sgl-kernel/pyproject.toml
+1
-1
sgl-kernel/pyproject_cpu.toml
sgl-kernel/pyproject_cpu.toml
+1
-1
sgl-kernel/pyproject_rocm.toml
sgl-kernel/pyproject_rocm.toml
+1
-1
sgl-kernel/python/sgl_kernel/version.py
sgl-kernel/python/sgl_kernel/version.py
+1
-1
No files found.
docker/Dockerfile.blackwell
View file @
7046e0fa
...
...
@@ -20,13 +20,13 @@ RUN echo 'tzdata tzdata/Areas select America' | debconf-set-selections \
RUN pip3 install torch==2.7.1 torchvision==0.22.1 torchaudio==2.7.1 --index-url https://download.pytorch.org/whl/cu128 --break-system-packages
RUN pip3 install https://github.com/sgl-project/whl/releases/download/v0.1.
7
/sgl_kernel-0.1.
7
+cu128-cp39-abi3-manylinux2014_x86_64.whl --break-system-packages \
RUN pip3 install https://github.com/sgl-project/whl/releases/download/v0.1.
8
/sgl_kernel-0.1.
8
+cu128-cp39-abi3-manylinux2014_x86_64.whl --break-system-packages \
&& pip3 install setuptools==75.0.0 wheel scikit-build-core --break-system-packages
RUN git clone --depth=1 https://github.com/sgl-project/sglang.git \
&& cd sglang && pip3 install -e "python[blackwell]" --break-system-packages
RUN pip3 install nvidia-nccl-cu12==2.2
6.2.post1
--force-reinstall --no-deps --break-system-packages
RUN pip3 install nvidia-nccl-cu12==2.2
7.3
--force-reinstall --no-deps --break-system-packages
RUN pip3 install flashinfer_python==0.2.6.post1 --break-system-packages
...
...
sgl-kernel/CMakeLists.txt
View file @
7046e0fa
...
...
@@ -39,6 +39,14 @@ find_package(Torch REQUIRED)
# clean Torch Flag
clear_cuda_arches
(
CMAKE_FLAG
)
if
(
"
${
CUDA_VERSION
}
"
VERSION_EQUAL
"12.8"
)
set
(
DeepGEMM_REPO
"https://github.com/sgl-project/DeepGEMM"
)
set
(
DeepGEMM_TAG
"blackwell"
)
else
()
set
(
DeepGEMM_REPO
"https://github.com/deepseek-ai/DeepGEMM"
)
set
(
DeepGEMM_TAG
"8dfa3298274bfe6b242f6f8a3e6f3eff2707dd9f"
)
endif
()
include
(
FetchContent
)
# cutlass
...
...
@@ -52,8 +60,8 @@ FetchContent_Populate(repo-cutlass)
# DeepGEMM
FetchContent_Declare
(
repo-deepgemm
GIT_REPOSITORY
https://github.com/deepseek-ai/
DeepGEMM
GIT_TAG
8dfa3298274bfe6b242f6f8a3e6f3eff2707dd9f
GIT_REPOSITORY
${
DeepGEMM
_REPO
}
GIT_TAG
${
DeepGEMM_TAG
}
GIT_SHALLOW OFF
)
FetchContent_Populate
(
repo-deepgemm
)
...
...
sgl-kernel/pyproject.toml
View file @
7046e0fa
...
...
@@ -8,7 +8,7 @@ build-backend = "scikit_build_core.build"
[project]
name
=
"sgl-kernel"
version
=
"0.1.
7
"
version
=
"0.1.
8
"
description
=
"Kernel Library for SGLang"
readme
=
"README.md"
requires-python
=
">=3.9"
...
...
sgl-kernel/pyproject_cpu.toml
View file @
7046e0fa
...
...
@@ -8,7 +8,7 @@ build-backend = "scikit_build_core.build"
[project]
name
=
"sgl-kernel"
version
=
"0.1.
7
"
version
=
"0.1.
8
"
description
=
"Kernel Library for SGLang"
readme
=
"README.md"
requires-python
=
">=3.9"
...
...
sgl-kernel/pyproject_rocm.toml
View file @
7046e0fa
...
...
@@ -9,7 +9,7 @@ build-backend = "setuptools.build_meta"
[project]
name
=
"sgl-kernel"
version
=
"0.1.
7
"
version
=
"0.1.
8
"
description
=
"Kernel Library for SGLang"
readme
=
"README.md"
requires-python
=
">=3.9"
...
...
sgl-kernel/python/sgl_kernel/version.py
View file @
7046e0fa
__version__
=
"0.1.
7
"
__version__
=
"0.1.
8
"
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment