Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
f58b929a
"torchvision/csrc/ops/ps_roi_align.cpp" did not exist on "b93d5ee2ddcf2a9876b5871cbb958016e263336b"
Unverified
Commit
f58b929a
authored
Apr 13, 2025
by
Yineng Zhang
Committed by
GitHub
Apr 13, 2025
Browse files
chore: upgrade sgl-kernel 0.0.8.post3 (#5342)
parent
c1270aab
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
3 additions
and
3 deletions
+3
-3
python/pyproject.toml
python/pyproject.toml
+1
-1
python/sglang/srt/layers/quantization/fp8_kernel.py
python/sglang/srt/layers/quantization/fp8_kernel.py
+1
-1
scripts/ci_install_dependency.sh
scripts/ci_install_dependency.sh
+1
-1
No files found.
python/pyproject.toml
View file @
f58b929a
...
...
@@ -47,7 +47,7 @@ runtime_common = [
srt
=
[
"sglang[runtime_common]"
,
"sgl-kernel==0.0.8"
,
"sgl-kernel==0.0.8
.post3
"
,
"flashinfer_python==0.2.3"
,
"torch==2.5.1"
,
"torchvision==0.20.1"
,
...
...
python/sglang/srt/layers/quantization/fp8_kernel.py
View file @
f58b929a
...
...
@@ -41,7 +41,7 @@ fp8_type_ = torch.float8_e4m3fnuz if _is_hip else torch.float8_e4m3fn
_is_cuda
=
is_cuda
()
if
_is_cuda
:
import
deep_gemm
# `pip install "sgl-kernel>=0.0.4.post3"`
import
deep_gemm
from
sgl_kernel
import
sgl_per_token_group_quant_fp8
,
sgl_per_token_quant_fp8
sm_version
=
get_device_sm
()
...
...
scripts/ci_install_dependency.sh
View file @
f58b929a
...
...
@@ -20,7 +20,7 @@ pip install --upgrade pip
# Install flashinfer and sgl-kernel
pip
install
flashinfer_python
==
0.2.3
--find-links
${
FLASHINFER_REPO
}
--no-cache-dir
pip
install
sgl-kernel
==
0.0.8
--no-cache-dir
pip
install
sgl-kernel
==
0.0.8
.post3
--no-cache-dir
# Install the main package
pip
install
-e
"python[all]"
--find-links
${
FLASHINFER_REPO
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment