Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
35396f41
Commit
35396f41
authored
Aug 05, 2025
by
zhuwenwen
Browse files
skip rocm_aiter_mla
parent
ebdb56e1
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
5 deletions
+6
-5
vllm/platforms/rocm.py
vllm/platforms/rocm.py
+6
-5
No files found.
vllm/platforms/rocm.py
View file @
35396f41
...
...
@@ -178,13 +178,14 @@ class RocmPlatform(Platform):
kv_cache_dtype
,
block_size
,
use_v1
,
use_mla
)
->
str
:
if
use_mla
:
from
vllm.attention.backends.rocm_aiter_mla
import
(
is_aiter_mla_enabled
)
#
from vllm.attention.backends.rocm_aiter_mla import (
#
is_aiter_mla_enabled)
if
selected_backend
is
None
:
selected_backend
=
(
_Backend
.
ROCM_AITER_MLA
if
is_aiter_mla_enabled
()
or
block_size
==
1
else
_Backend
.
TRITON_MLA
)
# selected_backend = (_Backend.ROCM_AITER_MLA if
# is_aiter_mla_enabled() or block_size == 1
# else _Backend.TRITON_MLA)
selected_backend
=
_Backend
.
TRITON_MLA
if
selected_backend
==
_Backend
.
TRITON_MLA
:
if
block_size
!=
1
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment