Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
ea7a9236
Unverified
Commit
ea7a9236
authored
Aug 29, 2025
by
Tzu-Ling Kan
Committed by
GitHub
Aug 29, 2025
Browse files
fix: Remove duplicate import and update the test comment. (#2784)
Signed-off-by:
tzulingk@nvidia.com
<
tzulingk@nvidia.com
>
parent
1f6b83be
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
13 additions
and
7 deletions
+13
-7
tests/serve/test_trtllm.py
tests/serve/test_trtllm.py
+13
-7
No files found.
tests/serve/test_trtllm.py
View file @
ea7a9236
...
@@ -175,13 +175,10 @@ def test_metrics_labels(request, runtime_services):
...
@@ -175,13 +175,10 @@ def test_metrics_labels(request, runtime_services):
Test that the trtllm backend correctly exports model labels in its metrics.
Test that the trtllm backend correctly exports model labels in its metrics.
This test uses the --extra-engine-args flag with agg.yaml configuration
This test uses the --extra-engine-args flag with agg.yaml configuration
to start the backend
without needing a pre-built TensorRT-LLM engine
.
to start the backend.
Prerequisites:
The test runs from the trtllm directory to access engine_configs/agg.yaml
- etcd and NATS must be running (docker compose -f deploy/docker-compose.yml up -d)
- The test runs from the trtllm directory to access engine_configs/agg.yaml
"""
"""
import
os
import
re
import
re
import
subprocess
import
subprocess
import
threading
import
threading
...
@@ -198,9 +195,18 @@ def test_metrics_labels(request, runtime_services):
...
@@ -198,9 +195,18 @@ def test_metrics_labels(request, runtime_services):
metrics_port
=
8081
metrics_port
=
8081
timeout
=
60
timeout
=
60
# Change to the trtllm directory where engine_configs/agg.yaml exists
# Calculate the path to the trtllm directory from the test file location
test_dir
=
os
.
path
.
dirname
(
os
.
path
.
abspath
(
__file__
))
# Go up two levels from tests/serve/
project_root
=
os
.
path
.
dirname
(
os
.
path
.
dirname
(
test_dir
))
working_directory
=
os
.
path
.
join
(
project_root
,
"components"
,
"backends"
,
"trtllm"
)
working_directory
=
os
.
path
.
abspath
(
"components/backends/trtllm"
)
# Verify the engine config file exists
engine_config_path
=
os
.
path
.
join
(
working_directory
,
agg_engine_args
)
if
not
os
.
path
.
exists
(
engine_config_path
):
pytest
.
fail
(
f
"Engine config file not found at:
{
engine_config_path
}
"
)
logger
.
info
(
f
"Using engine config from:
{
engine_config_path
}
"
)
# Build command using the user's working command
# Build command using the user's working command
command
=
[
command
=
[
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment