Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
c5932e5d
Unverified
Commit
c5932e5d
authored
Feb 03, 2025
by
Eldar Kurtic
Committed by
GitHub
Feb 03, 2025
Browse files
Properly check if all fused layers are in the list of targets (#12666)
Thanks @kylesayrs for catching this!
parent
20579c0f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
vllm/model_executor/layers/quantization/compressed_tensors/utils.py
..._executor/layers/quantization/compressed_tensors/utils.py
+1
-1
No files found.
vllm/model_executor/layers/quantization/compressed_tensors/utils.py
View file @
c5932e5d
...
@@ -236,7 +236,7 @@ def _match_fused_layer(layer_name: str,
...
@@ -236,7 +236,7 @@ def _match_fused_layer(layer_name: str,
for
type_suffix
in
possible_layer_types
)
for
type_suffix
in
possible_layer_types
)
if
is_same_parent
and
is_matching_type
and
all
(
if
is_same_parent
and
is_matching_type
and
all
(
'.'
.
join
([
parent_path
,
type_suffix
]
)
(
f
"
{
parent_path
}
.
{
type_suffix
}
"
in
target_layers
)
for
type_suffix
in
possible_layer_types
):
for
type_suffix
in
possible_layer_types
):
return
target
return
target
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment