Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
5c54ef03
Unverified
Commit
5c54ef03
authored
Feb 21, 2025
by
HAI
Committed by
GitHub
Feb 21, 2025
Browse files
AMD/ROCm: update AITER repo to ROCm/aiter (#3747)
parent
c6a48521
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
9 additions
and
8 deletions
+9
-8
docker/Dockerfile.rocm
docker/Dockerfile.rocm
+5
-4
python/sglang/srt/layers/moe/fused_moe_triton/layer.py
python/sglang/srt/layers/moe/fused_moe_triton/layer.py
+2
-2
python/sglang/srt/layers/quantization/fp8.py
python/sglang/srt/layers/quantization/fp8.py
+2
-2
No files found.
docker/Dockerfile.rocm
View file @
5c54ef03
...
...
@@ -17,8 +17,8 @@ ARG TRITON_REPO="https://github.com/ROCm/triton.git"
ARG TRITON_COMMIT="improve_fa_decode_3.0.0"
ARG ATER_REPO="https://github.com/
HaiShaw
/ater"
ARG
CK
_COMMIT
S
="
fa05ae
"
ARG A
I
TER_REPO="https://github.com/
ROCm
/a
i
ter
.git
"
ARG
AITER
_COMMIT="
dev/testx
"
RUN git clone ${SGL_REPO} \
&& cd sglang \
...
...
@@ -53,8 +53,9 @@ RUN git clone ${TRITON_REPO} \
&& cd python \
&& python3 setup.py install
RUN git clone ${ATER_REPO} \
&& cd ater \
RUN git clone ${AITER_REPO} \
&& cd aiter \
&& git checkout ${AITER_COMMIT} \
&& git submodule update --init --recursive \
&& PREBUILD_KERNELS=1 GPU_ARCHS=gfx942 python3 setup.py develop
...
...
python/sglang/srt/layers/moe/fused_moe_triton/layer.py
View file @
5c54ef03
...
...
@@ -167,8 +167,8 @@ class UnquantizedFusedMoEMethod(FusedMoEMethodBase, CustomOp):
)
if
is_hip_
and
get_bool_env_var
(
"CK_MOE"
):
import
ater
from
ater.fused_moe
import
fused_experts_ck
import
a
i
ter
from
a
i
ter.fused_moe
import
fused_experts_ck
assert
activation
==
"silu"
,
f
"
{
activation
=
}
is not supported."
...
...
python/sglang/srt/layers/quantization/fp8.py
View file @
5c54ef03
...
...
@@ -789,8 +789,8 @@ class Fp8MoEMethod:
)
if
is_hip_
and
get_bool_env_var
(
"CK_MOE"
):
import
ater
from
ater.fused_moe
import
fused_experts_ck
import
a
i
ter
from
a
i
ter.fused_moe
import
fused_experts_ck
assert
activation
==
"silu"
,
f
"
{
activation
=
}
is not supported."
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment