Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
5490d633
Unverified
Commit
5490d633
authored
Aug 30, 2025
by
Ning Xie
Committed by
GitHub
Aug 30, 2025
Browse files
[UT] fix unify_kv_cache_configs when kv cache config needs sort (#23843)
parent
628d00cd
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
2 deletions
+8
-2
tests/v1/core/test_kv_cache_utils.py
tests/v1/core/test_kv_cache_utils.py
+8
-2
No files found.
tests/v1/core/test_kv_cache_utils.py
View file @
5490d633
...
@@ -601,8 +601,14 @@ def test_unify_kv_cache_configs():
...
@@ -601,8 +601,14 @@ def test_unify_kv_cache_configs():
]
]
unify_kv_cache_configs
(
need_sort_kv_cache_config
)
unify_kv_cache_configs
(
need_sort_kv_cache_config
)
assert
need_sort_kv_cache_config
[
0
].
num_blocks
==
10
sorted_kv_cache_groups
=
[
assert
need_sort_kv_cache_config
[
1
].
num_blocks
==
10
KVCacheGroupSpec
([
"layer1"
],
new_kv_cache_spec
()),
KVCacheGroupSpec
([
"layer2"
],
new_kv_cache_spec
(
num_kv_heads
=
4
)),
]
assert
(
need_sort_kv_cache_config
[
0
].
kv_cache_groups
==
sorted_kv_cache_groups
)
assert
(
need_sort_kv_cache_config
[
1
].
kv_cache_groups
==
sorted_kv_cache_groups
)
diff_kv_cache_config
=
[
diff_kv_cache_config
=
[
KVCacheConfig
(
KVCacheConfig
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment