Commits · d1545621102a10ae70cd45ec9e644544858e59b1 · OpenDAS / dynamo

15 Jan, 2026 1 commit
- fix: consolidate return statement in get_engine_runtime_config (#5442) · d1545621
  dagil-nvidia authored Jan 15, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  d1545621
14 Jan, 2026 1 commit
- chore(router): Remove deprecated best_worker_id and metrics_labels (#5412) · c5458b99
  Graham King authored Jan 14, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c5458b99
13 Jan, 2026 1 commit
- feat: Propagate OTEL tracing context for trtllm (#5377) · 8c129ed4
  jh-nv authored Jan 13, 2026
  
  8c129ed4
09 Jan, 2026 1 commit
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
07 Jan, 2026 2 commits
- fix: Optimize TRTLLM multimodal request processing by reusing the tokenizer (#5217) · 535528a5
  Indrajit Bhosale authored Jan 07, 2026
  
  535528a5
- fix: KvCacheConfig Settings Lost When Publishing Events (#5198) · 66dfc494
  Indrajit Bhosale authored Jan 07, 2026
  
  66dfc494
05 Jan, 2026 1 commit
- fix: the error when encountering pure text conversations (#5088) · ea950355
  shpgy-shpgy authored Jan 06, 2026
```
Signed-off-by: shpgy-shpgy <875664365@qq.com>
```
  ea950355
03 Jan, 2026 1 commit
- fix(sglang): expose TokenizerMetricsCollector metrics via Prometheus (#5120) · 3e341fd6
  ishandhanani authored Jan 03, 2026
  
  3e341fd6
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
30 Dec, 2025 1 commit

fix: Fix TRTLLM disagg with kv router (#4950) · d7c27e68

jthomson04 authored Dec 29, 2025


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

d7c27e68

18 Dec, 2025 1 commit
- feat: switch to tcp as default request plane (#4845) · 18b64e90
  Biswa Panda authored Dec 18, 2025
  
  18b64e90
12 Dec, 2025 1 commit
- chore: enable local indexers for sglang and trtllm (#4932) · c2a29f80
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c2a29f80
11 Dec, 2025 1 commit
- chore: TRTLLM 1.2.0rc4 (#4836) · 52503032
  Dmitry Tokarev authored Dec 10, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  52503032
09 Dec, 2025 3 commits
- feat: nixl_connect: Improve Concurrency Support (#4433) · 96fe63fe
  J Wyman authored Dec 09, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
```
  96fe63fe
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- fix: backend error serialization and add HTTP status code detection (#4786) · 065f466e
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  065f466e
03 Dec, 2025 1 commit
- test: bring back the framework 1 gpu pre-merge tests + clean up pytest markers (#4698) · 7e499b5c
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e499b5c
02 Dec, 2025 3 commits

feat: Extend the KV Event Consolidator to support TensorRT-LLM (#4533) · 6067c59d
Kris Hung authored Dec 02, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
6067c59d

fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union... · 4ace4c85

GuanLuo authored Dec 02, 2025

fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union from different files (#3192)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

4ace4c85

feat: Adding --dyn-endpoint-types flag (#4619) · 03070fd5

KrishnanPrash authored Dec 02, 2025


Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

03070fd5

01 Dec, 2025 1 commit

test: Add pytest markers (#4111) · 0f6dca6e

Pavithra Vijayakrishnan authored Dec 01, 2025


Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>

0f6dca6e

22 Nov, 2025 1 commit

chore: upgrade trtllm 1.2.0rc2 (#4405) · 9b8b9988

Dmitry Tokarev authored Nov 21, 2025


Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Kyle McGill <kmcgill@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>

9b8b9988

19 Nov, 2025 2 commits
- feat: Enable autodeploy as a backend for TRT-LLM (#4347) · fe21d3dd
  William Zhang authored Nov 19, 2025
```
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
```
  fe21d3dd
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
18 Nov, 2025 2 commits
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
17 Nov, 2025 1 commit
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
13 Nov, 2025 1 commit

refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c

Keiven C authored Nov 13, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

381c428c

11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
07 Nov, 2025 1 commit
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
05 Nov, 2025 1 commit
- chore: trtllm use unified frontend (#4097) · 9fa8125c
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9fa8125c
04 Nov, 2025 1 commit

fix: add prefill metrics support for TensorRT-LLM disaggregated mode (#3983) · ba51c683

Keiven C authored Nov 04, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

ba51c683

03 Nov, 2025 1 commit
- test: move backend unit tests (#3958) · 30d85883
  Pavithra Vijayakrishnan authored Nov 02, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  30d85883
28 Oct, 2025 1 commit
- chore(runtime): Do not expose etcd lease ID (#3915) · c78b5901
  Graham King authored Oct 28, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c78b5901
22 Oct, 2025 1 commit
- feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f93b619a
14 Oct, 2025 2 commits
- feat: catch Trtllm engine exceptions (#3544) · 1ad2a3b8
  Tzu-Ling Kan authored Oct 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1ad2a3b8
- fix: only log config on `debug` log level, fix trtllm warnings (#3590) · 7b0fad3f
  William Arnold authored Oct 14, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  7b0fad3f
10 Oct, 2025 1 commit
- ci: TRTLLM & SGLang Unit Tests (for --custom-jinja-template) (#3472) · a3d46840
  KrishnanPrash authored Oct 10, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  a3d46840
08 Oct, 2025 1 commit
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
07 Oct, 2025 1 commit

feat: Connect DYN_LOG level to TLLM_LOG_LEVEL (#3451) · 68bbe8a9

Tanmay Verma authored Oct 07, 2025


Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

68bbe8a9