Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
eaf42eb0
Unverified
Commit
eaf42eb0
authored
Aug 15, 2025
by
Yan Ru Pei
Committed by
GitHub
Aug 15, 2025
Browse files
fix: revert registering runtime config for trtllm backend (deadlock) (#2464)
Signed-off-by:
Yan Ru Pei
<
yanrpei@gmail.com
>
parent
0a1168c4
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
4 deletions
+0
-4
components/backends/trtllm/src/dynamo/trtllm/main.py
components/backends/trtllm/src/dynamo/trtllm/main.py
+0
-4
No files found.
components/backends/trtllm/src/dynamo/trtllm/main.py
View file @
eaf42eb0
...
@@ -229,9 +229,6 @@ async def init(runtime: DistributedRuntime, config: Config):
...
@@ -229,9 +229,6 @@ async def init(runtime: DistributedRuntime, config: Config):
endpoint
=
component
.
endpoint
(
config
.
endpoint
)
endpoint
=
component
.
endpoint
(
config
.
endpoint
)
if
is_first_worker
(
config
):
if
is_first_worker
(
config
):
# Get runtime configuration from the engine
runtime_config
=
await
get_engine_runtime_config
(
engine
,
config
)
# Register the model with runtime config
# Register the model with runtime config
await
register_llm
(
await
register_llm
(
modelType
,
modelType
,
...
@@ -240,7 +237,6 @@ async def init(runtime: DistributedRuntime, config: Config):
...
@@ -240,7 +237,6 @@ async def init(runtime: DistributedRuntime, config: Config):
config
.
served_model_name
,
config
.
served_model_name
,
kv_cache_block_size
=
config
.
kv_block_size
,
kv_cache_block_size
=
config
.
kv_block_size
,
migration_limit
=
config
.
migration_limit
,
migration_limit
=
config
.
migration_limit
,
runtime_config
=
runtime_config
,
# Add runtime config here
)
)
# publisher will be set later if publishing is enabled.
# publisher will be set later if publishing is enabled.
handler_config
=
RequestHandlerConfig
(
handler_config
=
RequestHandlerConfig
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment