Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
947dfda9
Unverified
Commit
947dfda9
authored
Dec 11, 2025
by
Nick Hill
Committed by
GitHub
Dec 11, 2025
Browse files
[LMCache] Relax lmcache version requirement (#30425)
Signed-off-by:
Nick Hill
<
nhill@redhat.com
>
parent
9f2fc16a
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
9 additions
and
2 deletions
+9
-2
requirements/kv_connectors.txt
requirements/kv_connectors.txt
+1
-1
vllm/distributed/kv_transfer/kv_connector/v1/lmcache_integration/vllm_v1_adapter.py
...er/kv_connector/v1/lmcache_integration/vllm_v1_adapter.py
+8
-1
No files found.
requirements/kv_connectors.txt
View file @
947dfda9
lmcache
>= 0.3.10.post1
lmcache
nixl >= 0.7.1 # Required for disaggregated prefill
vllm/distributed/kv_transfer/kv_connector/v1/lmcache_integration/vllm_v1_adapter.py
View file @
947dfda9
...
...
@@ -27,7 +27,14 @@ from lmcache.v1.lookup_client.lmcache_async_lookup_client import (
LMCacheAsyncLookupServer
,
)
from
lmcache.v1.offload_server.zmq_server
import
ZMQOffloadServer
from
lmcache.v1.plugin.runtime_plugin_launcher
import
RuntimePluginLauncher
try
:
from
lmcache.v1.plugin.runtime_plugin_launcher
import
RuntimePluginLauncher
except
ImportError
:
# Backwards compatibility for lmcache <= 0.3.10-post1
from
lmcache.v1.plugin.plugin_launcher
import
(
PluginLauncher
as
RuntimePluginLauncher
,
)
from
vllm.attention.backends.abstract
import
AttentionMetadata
from
vllm.config
import
VllmConfig
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment