Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
1a9aeab4
"lib/mocker/src/common/protocols.rs" did not exist on "63bee8b3039e3598860f2edca06b84f4e452c963"
Unverified
Commit
1a9aeab4
authored
Nov 05, 2025
by
Kris Hung
Committed by
GitHub
Nov 05, 2025
Browse files
fix: Remove hard dep on kvbm (#4127)
parent
482a7919
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
12 additions
and
2 deletions
+12
-2
components/src/dynamo/vllm/main.py
components/src/dynamo/vllm/main.py
+12
-2
No files found.
components/src/dynamo/vllm/main.py
View file @
1a9aeab4
...
@@ -8,7 +8,6 @@ import signal
...
@@ -8,7 +8,6 @@ import signal
from
typing
import
Optional
from
typing
import
Optional
import
uvloop
import
uvloop
from
kvbm.vllm_integration.consolidator_config
import
get_consolidator_endpoints
from
prometheus_client
import
REGISTRY
from
prometheus_client
import
REGISTRY
from
vllm.distributed.kv_events
import
ZmqEventPublisher
from
vllm.distributed.kv_events
import
ZmqEventPublisher
from
vllm.usage.usage_lib
import
UsageContext
from
vllm.usage.usage_lib
import
UsageContext
...
@@ -216,7 +215,18 @@ def setup_vllm_engine(config, stat_logger=None):
...
@@ -216,7 +215,18 @@ def setup_vllm_engine(config, stat_logger=None):
# Set up consolidator endpoints if KVBM is enabled
# Set up consolidator endpoints if KVBM is enabled
consolidator_endpoints
=
None
consolidator_endpoints
=
None
if
config
.
has_connector
(
"kvbm"
):
if
config
.
has_connector
(
"kvbm"
):
try
:
from
kvbm.vllm_integration.consolidator_config
import
(
get_consolidator_endpoints
,
)
consolidator_endpoints
=
get_consolidator_endpoints
(
vllm_config
)
consolidator_endpoints
=
get_consolidator_endpoints
(
vllm_config
)
except
Exception
as
e
:
logger
.
warning
(
f
"KVBM connector is enabled but failed to get consolidator endpoints:
{
e
}
. "
"Continuing without KV event consolidation. "
"Ensure 'kvbm' package is installed if this feature is needed."
)
vllm_config
.
consolidator_endpoints
=
consolidator_endpoints
vllm_config
.
consolidator_endpoints
=
consolidator_endpoints
factory
=
[]
factory
=
[]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment