Commits · 98d0ce91b8c7ff0fceefe705a0b308ab158528af · OpenDAS / dynamo · GitLab

28 Mar, 2026 1 commit
- feat: Support a dynamic default max_tokens for TensorRT-LLM backend (#5152) · 98d0ce91
  Steven Murr authored Mar 27, 2026
```
Signed-off-by: Steven Murr <stevemurr@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  98d0ce91
19 Mar, 2026 1 commit
- feat: enable mypy in pre-merge (#6732) · 2712426f
  jh-nv authored Mar 19, 2026
  
  2712426f
13 Mar, 2026 1 commit
- fix: reject multimodal requests when worker lacks --modality multimodal (#7065) · 4105de62
  KrishnanPrash authored Mar 13, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  4105de62
11 Mar, 2026 1 commit

fix: serialize disagg first_gen_log_probs int keys for Rust transport (#7145) · e930526b

Yuewei Na authored Mar 10, 2026


Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

e930526b

06 Mar, 2026 2 commits
- feat(trtllm): add additional metrics for dynamo-trtllm (#6668) · 10081929
  Yifan Jiang authored Mar 06, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  10081929
- chore: add mypy typing for trtllm (#6860) · f99b78f0
  jh-nv authored Mar 05, 2026
  
  f99b78f0
03 Mar, 2026 1 commit
- fix: Fix E + PD Multimodal Flow in trtllm (#6726) · 47ed1227
  Indrajit Bhosale authored Mar 02, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  47ed1227
26 Feb, 2026 2 commits
- fix: guided decoding arg placement, None guard, test cleanup (#6617) · 1e44ab95
  Yifan Jiang authored Feb 26, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
```
  1e44ab95
- feat: add guided decoding backend config and choice support for TRT-LLM (#5762) · 01ecc8c7
  Yifan Jiang authored Feb 25, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
```
  01ecc8c7
24 Feb, 2026 1 commit
- chore: Expose new kv_cache metrics from trtllm backend (#6469) · eb76a8b5
  Indrajit Bhosale authored Feb 23, 2026
  
  eb76a8b5
23 Feb, 2026 1 commit
- feat: Remove Component from public (#6403) · 80cac7c1
  Tzu-Ling Kan authored Feb 23, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  80cac7c1
20 Feb, 2026 2 commits
- feat: Configurable Request Cancellation abort passage to TRT-LLM (#6445) · 41d7d549
  Jacky authored Feb 20, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  41d7d549
- feat: TRT-LLM multimodal preprocessor with backend media decoding (#5910) · 8a098a66
  Michal Guzek authored Feb 19, 2026
```
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
```
  8a098a66
11 Feb, 2026 1 commit
- fix: convert guided_decoding dict to GuidedDecodingParams in TRT-LLM handler (#6127) · 5602dd2f
  Yuewei Na authored Feb 11, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  5602dd2f
10 Feb, 2026 1 commit

feat: add video diffusion support to TRTLLM backend (wan_t2v only) (#5926) · df2daadd

Yuewei Na authored Feb 10, 2026


Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Signed-off-by: Yuewei Na <248773860+nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>

df2daadd

06 Feb, 2026 1 commit
- feat: TRTLLM DP Rank Routing (#5936) · b5c0db63
  Karen Chung authored Feb 05, 2026
  
  b5c0db63
04 Feb, 2026 1 commit
- feat: add EncoderCacheManager to TRT-LLM PrefillHandler (#5714) · b82b45a1
  Qi Wang authored Feb 03, 2026
  
  b82b45a1
30 Jan, 2026 3 commits
- fix: Disable calls to abort() at TRT-LLM backend - temporary (#5827) · 934d03c5
  Jacky authored Jan 30, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  934d03c5
- fix: Properly forward sampling params from the request (#5797) · 2f666b73
  William Zhang authored Jan 30, 2026
  
  2f666b73
- fix: Temporary disable cancellation at TRT-LLM decode worker (#5764) · b10d103d
  Jacky authored Jan 29, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  b10d103d
27 Jan, 2026 1 commit
- feat: request migration for trtllm (#5599) · a9b74dc2
  jh-nv authored Jan 26, 2026
  
  a9b74dc2
22 Jan, 2026 1 commit

feat: Standalone encoder in dynamo trtllm (#4668) · 66963b70

Indrajit Bhosale authored Jan 22, 2026

Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

66963b70

13 Jan, 2026 1 commit
- feat: Propagate OTEL tracing context for trtllm (#5377) · 8c129ed4
  jh-nv authored Jan 13, 2026
  
  8c129ed4
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
30 Dec, 2025 1 commit

fix: Fix TRTLLM disagg with kv router (#4950) · d7c27e68

jthomson04 authored Dec 29, 2025


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

d7c27e68

09 Dec, 2025 2 commits
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- fix: backend error serialization and add HTTP status code detection (#4786) · 065f466e
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  065f466e
02 Dec, 2025 1 commit

fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union... · 4ace4c85

GuanLuo authored Dec 02, 2025

fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union from different files (#3192)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

4ace4c85

18 Nov, 2025 2 commits
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
05 Nov, 2025 1 commit
- chore: trtllm use unified frontend (#4097) · 9fa8125c
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9fa8125c
22 Oct, 2025 1 commit
- feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f93b619a
14 Oct, 2025 1 commit
- feat: catch Trtllm engine exceptions (#3544) · 1ad2a3b8
  Tzu-Ling Kan authored Oct 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1ad2a3b8
08 Oct, 2025 1 commit
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
01 Oct, 2025 1 commit
- feat: restructure source code for python packaging (#3201) · 836d7417
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  836d7417
30 Sep, 2025 2 commits
- refactor: Simplify TRT-LLM request abort calling logic (#3296) · 87190db0
  Jacky authored Sep 30, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  87190db0
- fix: Install right versions of the dependencies for tensorrtllm (#3218) · c265cd67
  Tanmay Verma authored Sep 30, 2025
  
  c265cd67
26 Sep, 2025 1 commit
- feat: Request Cancellation TRT-LLM (#3193) · 77e66ae5
  Jacky authored Sep 26, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  77e66ae5
17 Sep, 2025 1 commit
- fix: resolve token loss bug in final packet (#2985) · 045b61dd
  Xuwei authored Sep 17, 2025
```
Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>
```
  045b61dd
09 Sep, 2025 1 commit
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e