Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
e3691988
Unverified
Commit
e3691988
authored
Feb 27, 2026
by
Rohan Potdar
Committed by
GitHub
Feb 27, 2026
Browse files
[ROCm]: fix aiter rope functionalization (#35533)
Signed-off-by:
Rohan138
<
rohanpotdar138@gmail.com
>
parent
9fa6c68f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
1 deletion
+9
-1
vllm/compilation/passes/utility/fix_functionalization.py
vllm/compilation/passes/utility/fix_functionalization.py
+9
-1
No files found.
vllm/compilation/passes/utility/fix_functionalization.py
View file @
e3691988
...
...
@@ -37,6 +37,14 @@ class FixFunctionalizationPass(VllmInductorPass):
self
.
nodes_to_remove
:
list
[
torch
.
fx
.
Node
]
=
[]
count
=
0
rope_targets
=
[
torch
.
ops
.
_C
.
rotary_embedding
.
default
]
if
hasattr
(
torch
.
ops
.
vllm
,
"rocm_aiter_triton_rotary_embedding"
):
rope_targets
.
append
(
torch
.
ops
.
vllm
.
rocm_aiter_triton_rotary_embedding
.
default
)
for
node
in
graph
.
nodes
:
if
not
is_func
(
node
,
auto_functionalized
):
continue
# Avoid deep if-elif nesting
...
...
@@ -44,7 +52,7 @@ class FixFunctionalizationPass(VllmInductorPass):
kwargs
=
node
.
kwargs
at_target
=
node
.
args
[
0
]
if
at_target
==
torch
.
ops
.
_C
.
rotary_embedding
.
default
:
if
at_target
in
rope_targets
:
query
=
kwargs
[
"query"
]
key
=
kwargs
[
"key"
]
getitem_nodes
=
self
.
getitem_users
(
node
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment