Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
cb39311b
"examples/vscode:/vscode.git/clone" did not exist on "608bb1446285db42fcc3aa33881c8c5dd0646ce0"
Unverified
Commit
cb39311b
authored
Feb 26, 2026
by
Tanmay Verma
Committed by
GitHub
Feb 26, 2026
Browse files
docs: Add docs of backend logging behavior (#6608)
parent
a35df0f5
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
52 additions
and
0 deletions
+52
-0
docs/pages/observability/logging.md
docs/pages/observability/logging.md
+52
-0
No files found.
docs/pages/observability/logging.md
View file @
cb39311b
...
@@ -20,6 +20,9 @@ enabled via the `DYN_LOGGING_SPAN_EVENTS` environment variable.
...
@@ -20,6 +20,9 @@ enabled via the `DYN_LOGGING_SPAN_EVENTS` environment variable.
|
`DYN_LOG`
| Log levels per target
`<default_level>,<module_path>=<level>,<module_path>=<level>`
|
`info`
|
`DYN_LOG=info,dynamo_runtime::system_status_server:trace`
|
|
`DYN_LOG`
| Log levels per target
`<default_level>,<module_path>=<level>,<module_path>=<level>`
|
`info`
|
`DYN_LOG=info,dynamo_runtime::system_status_server:trace`
|
|
`DYN_LOG_USE_LOCAL_TZ`
| Use local timezone for timestamps (default is UTC) |
`false`
|
`true`
|
|
`DYN_LOG_USE_LOCAL_TZ`
| Use local timezone for timestamps (default is UTC) |
`false`
|
`true`
|
|
`DYN_LOGGING_CONFIG_PATH`
| Path to custom TOML logging configuration | none |
`/path/to/config.toml`
|
|
`DYN_LOGGING_CONFIG_PATH`
| Path to custom TOML logging configuration | none |
`/path/to/config.toml`
|
|
`VLLM_LOGGING_LEVEL`
| vLLM backend log level (independent of
`DYN_LOG`
) |
`INFO`
|
`DEBUG`
|
|
`TLLM_LOG_LEVEL`
| TensorRT-LLM backend log level (independent of
`DYN_LOG`
) |
`INFO`
|
`DEBUG`
|
|
`DYN_SKIP_SGLANG_LOG_FORMATTING`
| Disable Dynamo's SGLang log configuration |
`false`
|
`true`
|
|
`OTEL_SERVICE_NAME`
| Service name for trace and span information |
`dynamo`
|
`dynamo-frontend`
|
|
`OTEL_SERVICE_NAME`
| Service name for trace and span information |
`dynamo`
|
`dynamo-frontend`
|
|
`OTEL_EXPORT_ENABLED`
| Enable OTLP trace exporting |
`false`
|
`true`
|
|
`OTEL_EXPORT_ENABLED`
| Enable OTLP trace exporting |
`false`
|
`true`
|
|
`OTEL_EXPORTER_OTLP_TRACES_ENDPOINT`
| OTLP exporter endpoint |
`http://localhost:4317`
|
`http://tempo:4317`
|
|
`OTEL_EXPORTER_OTLP_TRACES_ENDPOINT`
| OTLP exporter endpoint |
`http://localhost:4317`
|
`http://tempo:4317`
|
...
@@ -259,6 +262,55 @@ Notice how the `x_request_id` field appears in all log entries, alongside the `t
...
@@ -259,6 +262,55 @@ Notice how the `x_request_id` field appears in all log entries, alongside the `t
## Backend Engine Log Levels
Dynamo's
`DYN_LOG`
environment variable controls Dynamo's own logging. Each
inference backend has its own log level control that is
**independent**
of
`DYN_LOG`
.
### vLLM
vLLM log level is controlled by the
`VLLM_LOGGING_LEVEL`
environment variable.
It defaults to
`INFO`
and is completely independent of
`DYN_LOG`
.
```
bash
# Set vLLM to debug while keeping Dynamo at info
export
DYN_LOG
=
info
export
VLLM_LOGGING_LEVEL
=
DEBUG
```
Valid values:
`DEBUG`
,
`INFO`
,
`WARNING`
,
`ERROR`
,
`CRITICAL`
.
### TensorRT-LLM
TensorRT-LLM log level is controlled by the
`TLLM_LOG_LEVEL`
environment
variable. It defaults to
`INFO`
and is completely independent of
`DYN_LOG`
.
```
bash
# Set TRT-LLM to info while keeping Dynamo at warn
export
DYN_LOG
=
warn
export
TLLM_LOG_LEVEL
=
INFO
```
Valid values:
`TRACE`
,
`DEBUG`
,
`INFO`
,
`WARNING`
,
`ERROR`
,
`INTERNAL_ERROR`
.
**Note:**
`TLLM_LOG_LEVEL`
is read once at TensorRT-LLM import time. It must
be set before the process starts.
### SGLang
SGLang logging is currently configured through Dynamo and follows the
`DYN_LOG`
level by default. To disable Dynamo's SGLang log configuration
and manage it independently, set:
```
bash
export
DYN_SKIP_SGLANG_LOG_FORMATTING
=
true
```
Alternatively, pass the
`--log-level`
argument to the SGLang worker
command to set the SGLang engine's log level directly (e.g.
`--log-level DEBUG`
). This is independent of
`DYN_LOG`
.
## Related Documentation
## Related Documentation
-
[
Distributed Runtime Architecture
](
../design-docs/distributed-runtime.md
)
-
[
Distributed Runtime Architecture
](
../design-docs/distributed-runtime.md
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment