Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
905c920b
Unverified
Commit
905c920b
authored
Sep 09, 2025
by
Biswa Panda
Committed by
GitHub
Sep 10, 2025
Browse files
fix: dyn namespace scoping for trtllm (#2970)
Signed-off-by:
Biswa Panda
<
biswa.panda@gmail.com
>
parent
ae38bd43
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
3 deletions
+6
-3
components/backends/trtllm/src/dynamo/trtllm/utils/trtllm_utils.py
...s/backends/trtllm/src/dynamo/trtllm/utils/trtllm_utils.py
+6
-3
No files found.
components/backends/trtllm/src/dynamo/trtllm/utils/trtllm_utils.py
View file @
905c920b
...
...
@@ -2,6 +2,7 @@
# SPDX-License-Identifier: Apache-2.0
import
argparse
import
os
from
typing
import
Optional
from
tensorrt_llm.llmapi
import
BuildConfig
...
...
@@ -13,11 +14,13 @@ from dynamo.trtllm.request_handlers.handler_base import (
DisaggregationStrategy
,
)
DYN_NAMESPACE
=
os
.
environ
.
get
(
"DYN_NAMESPACE"
,
"dynamo"
)
# Default endpoint for the next worker.
DEFAULT_ENDPOINT
=
"dyn://
dynamo
.tensorrt_llm.generate"
DEFAULT_ENDPOINT
=
f
"dyn://
{
DYN_NAMESPACE
}
.tensorrt_llm.generate"
DEFAULT_MODEL_PATH
=
"TinyLlama/TinyLlama-1.1B-Chat-v1.0"
DEFAULT_NEXT_ENDPOINT
=
"dyn://
dynamo
.tensorrt_llm_next.generate"
DEFAULT_ENCODE_ENDPOINT
=
"dyn://
dynamo
.tensorrt_llm_encode.generate"
DEFAULT_NEXT_ENDPOINT
=
f
"dyn://
{
DYN_NAMESPACE
}
.tensorrt_llm_next.generate"
DEFAULT_ENCODE_ENDPOINT
=
f
"dyn://
{
DYN_NAMESPACE
}
.tensorrt_llm_encode.generate"
DEFAULT_DISAGGREGATION_STRATEGY
=
DisaggregationStrategy
.
DECODE_FIRST
DEFAULT_DISAGGREGATION_MODE
=
DisaggregationMode
.
AGGREGATED
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment