Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
3a7cd627
Unverified
Commit
3a7cd627
authored
Jun 09, 2025
by
Siyuan Liu
Committed by
GitHub
Jun 09, 2025
Browse files
[Misc] Fix a config typo in disable_hybrid_kv_cache_manager configuration (#19383)
Signed-off-by:
Siyuan Liu
<
lsiyuan@google.com
>
parent
8058c911
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
vllm/config.py
vllm/config.py
+3
-3
No files found.
vllm/config.py
View file @
3a7cd627
...
...
@@ -4497,13 +4497,13 @@ class VllmConfig:
# warning message here and will log it later.
if
not
(
current_platform
.
is_cuda
()
or
current_platform
.
is_rocm
()):
# Hybrid KV cache manager is not supported on non-GPU platforms.
self
.
disable_hybrid_kv_cache_manager
=
True
self
.
scheduler_config
.
disable_hybrid_kv_cache_manager
=
True
if
self
.
kv_transfer_config
is
not
None
:
# Hybrid KV cache manager is not compatible with KV transfer.
self
.
disable_hybrid_kv_cache_manager
=
True
self
.
scheduler_config
.
disable_hybrid_kv_cache_manager
=
True
if
self
.
kv_events_config
is
not
None
:
# Hybrid KV cache manager is not compatible with KV events.
self
.
disable_hybrid_kv_cache_manager
=
True
self
.
scheduler_config
.
disable_hybrid_kv_cache_manager
=
True
def
update_sizes_for_sequence_parallelism
(
self
,
possible_sizes
:
list
)
->
list
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment