Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8da2f28f
Unverified
Commit
8da2f28f
authored
Nov 13, 2025
by
Pleaplusone
Committed by
GitHub
Nov 13, 2025
Browse files
[ROCm][BugFix]Fix `get_cu_count` in rocm_aiter_fa.py (#28618)
Signed-off-by:
ganyi
<
ygan@amd.com
>
parent
86d15bfd
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
vllm/v1/attention/backends/rocm_aiter_fa.py
vllm/v1/attention/backends/rocm_aiter_fa.py
+2
-1
No files found.
vllm/v1/attention/backends/rocm_aiter_fa.py
View file @
8da2f28f
...
...
@@ -18,6 +18,7 @@ from vllm.config import VllmConfig
from
vllm.logger
import
init_logger
from
vllm.platforms
import
current_platform
from
vllm.utils.math_utils
import
cdiv
from
vllm.utils.platform_utils
import
get_cu_count
from
vllm.v1.attention.backends.utils
import
(
AttentionCGSupport
,
AttentionMetadataBuilder
,
...
...
@@ -38,7 +39,7 @@ if current_platform.is_rocm():
return
min
(
65536
//
x
.
element_size
(),
triton
.
next_power_of_2
(
head_dim
))
def
num_programs
(
total_tokens
):
return
min
(
total_tokens
,
current_platform
.
get_cu_count
())
return
min
(
total_tokens
,
get_cu_count
())
@
triton
.
jit
def
cp_mha_gather_cache_kernel
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment