Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
180fba65
Unverified
Commit
180fba65
authored
Jan 21, 2026
by
Divakar Verma
Committed by
GitHub
Jan 21, 2026
Browse files
[ROCm] fix import for on_gfx9 (#32783)
Signed-off-by:
Divakar Verma
<
divakar.verma@amd.com
>
parent
f9995398
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
16 additions
and
2 deletions
+16
-2
vllm/model_executor/layers/fused_moe/fused_batched_moe.py
vllm/model_executor/layers/fused_moe/fused_batched_moe.py
+8
-1
vllm/model_executor/layers/fused_moe/fused_moe.py
vllm/model_executor/layers/fused_moe/fused_moe.py
+8
-1
No files found.
vllm/model_executor/layers/fused_moe/fused_batched_moe.py
View file @
180fba65
...
...
@@ -913,7 +913,14 @@ class BatchedTritonExperts(mk.FusedMoEPermuteExpertsUnpermute):
activation_key
:
QuantKey
|
None
,
)
->
bool
:
p
=
current_platform
device_supports_fp8
=
(
p
.
is_rocm
()
and
p
.
rocm
.
on_gfx9
())
or
(
if
p
.
is_rocm
():
from
vllm.platforms.rocm
import
on_gfx9
is_rocm_on_gfx9
=
on_gfx9
()
else
:
is_rocm_on_gfx9
=
False
device_supports_fp8
=
is_rocm_on_gfx9
or
(
p
.
is_cuda
()
and
p
.
has_device_capability
((
8
,
9
))
)
...
...
vllm/model_executor/layers/fused_moe/fused_moe.py
View file @
180fba65
...
...
@@ -1922,7 +1922,14 @@ class TritonExperts(mk.FusedMoEPermuteExpertsUnpermute):
activation_key
:
QuantKey
|
None
,
)
->
bool
:
p
=
current_platform
device_supports_fp8
=
(
p
.
is_rocm
()
and
p
.
rocm
.
on_gfx9
())
or
(
if
p
.
is_rocm
():
from
vllm.platforms.rocm
import
on_gfx9
is_rocm_on_gfx9
=
on_gfx9
()
else
:
is_rocm_on_gfx9
=
False
device_supports_fp8
=
is_rocm_on_gfx9
or
(
p
.
is_cuda
()
and
p
.
has_device_capability
((
8
,
9
))
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment