Commits · d1545621102a10ae70cd45ec9e644544858e59b1 · OpenDAS / dynamo

15 Jan, 2026 1 commit
- fix: consolidate return statement in get_engine_runtime_config (#5442) · d1545621
  dagil-nvidia authored Jan 15, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  d1545621
09 Jan, 2026 1 commit
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
07 Jan, 2026 1 commit
- fix: KvCacheConfig Settings Lost When Publishing Events (#5198) · 66dfc494
  Indrajit Bhosale authored Jan 07, 2026
  
  66dfc494
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
12 Dec, 2025 1 commit
- chore: enable local indexers for sglang and trtllm (#4932) · c2a29f80
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c2a29f80
11 Dec, 2025 1 commit
- chore: TRTLLM 1.2.0rc4 (#4836) · 52503032
  Dmitry Tokarev authored Dec 10, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  52503032
09 Dec, 2025 1 commit
- feat: nixl_connect: Improve Concurrency Support (#4433) · 96fe63fe
  J Wyman authored Dec 09, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
```
  96fe63fe
02 Dec, 2025 2 commits
- feat: Extend the KV Event Consolidator to support TensorRT-LLM (#4533) · 6067c59d
  Kris Hung authored Dec 02, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  6067c59d
- feat: Adding --dyn-endpoint-types flag (#4619) · 03070fd5
  KrishnanPrash authored Dec 02, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  03070fd5
22 Nov, 2025 1 commit

chore: upgrade trtllm 1.2.0rc2 (#4405) · 9b8b9988

Dmitry Tokarev authored Nov 21, 2025


Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Kyle McGill <kmcgill@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>

9b8b9988

19 Nov, 2025 2 commits
- feat: Enable autodeploy as a backend for TRT-LLM (#4347) · fe21d3dd
  William Zhang authored Nov 19, 2025
```
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
```
  fe21d3dd
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
18 Nov, 2025 2 commits
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
17 Nov, 2025 1 commit
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
13 Nov, 2025 1 commit

refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c

Keiven C authored Nov 13, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

381c428c

11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
07 Nov, 2025 1 commit
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
05 Nov, 2025 1 commit
- chore: trtllm use unified frontend (#4097) · 9fa8125c
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9fa8125c
04 Nov, 2025 1 commit

fix: add prefill metrics support for TensorRT-LLM disaggregated mode (#3983) · ba51c683

Keiven C authored Nov 04, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

ba51c683

28 Oct, 2025 1 commit
- chore(runtime): Do not expose etcd lease ID (#3915) · c78b5901
  Graham King authored Oct 28, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c78b5901
22 Oct, 2025 1 commit
- feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f93b619a
14 Oct, 2025 1 commit
- feat: catch Trtllm engine exceptions (#3544) · 1ad2a3b8
  Tzu-Ling Kan authored Oct 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1ad2a3b8
08 Oct, 2025 1 commit
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
07 Oct, 2025 2 commits
- feat: Connect DYN_LOG level to TLLM_LOG_LEVEL (#3451) · 68bbe8a9
  Tanmay Verma authored Oct 07, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  68bbe8a9
- feat: add flag for dumping dynamo engine config and environment (#3286) · 2e1f5076
  William Arnold authored Oct 07, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  2e1f5076
01 Oct, 2025 2 commits
- feat: restructure source code for python packaging (#3201) · 836d7417
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  836d7417
- feat: Add --custom-jinja-template argument to pass a custom chat template for TRTLLM (#3332) · b5782fcd
  KrishnanPrash authored Sep 30, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b5782fcd
24 Sep, 2025 1 commit
- feat: add NIM FE (num_request_max) + runtime config metrics with periodic polling (#3107) · 116b9b43
  Keiven C authored Sep 24, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  116b9b43
23 Sep, 2025 1 commit
- feat: Trtllm health check payload use bos_token_id (#3145) · 7b43b3a5
  Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  7b43b3a5
17 Sep, 2025 1 commit

feat: Trtllm canary health check (#3082) · 67ff181d

Tzu-Ling Kan authored Sep 17, 2025


Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>

67ff181d

16 Sep, 2025 1 commit
- fix: move deep_update function to trtllm folder (#3070) · 2bb1b268
  Hongkuan Zhou authored Sep 16, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2bb1b268
10 Sep, 2025 1 commit

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

09 Sep, 2025 1 commit
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
04 Sep, 2025 1 commit
- fix: Adding back runtime_config so that tool_parser work properly on … (#2855) · 9524a464
  zhongdaor-nv authored Sep 03, 2025
```
Co-authored-by: Zhongdao Ren <zhongdaor@ipp1-3309.ipp1a1.colossus.nvidia.com>
```
  9524a464
03 Sep, 2025 1 commit

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

30 Aug, 2025 1 commit

feat: add logits processor support for trtllm backend (#2702) · 43a26958

Bhuvan Agrawal authored Aug 29, 2025


Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

43a26958

29 Aug, 2025 2 commits
- feat: Add Encode Worker and NIXL support to trtllm multimodal flow (#2452) · 781fa062
  Indrajit Bhosale authored Aug 29, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  781fa062
- fix: [trtllm] add wait_for_instance before register_llm (#2683) · 8c2072cf
  Alec authored Aug 28, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  8c2072cf
27 Aug, 2025 1 commit
- feat: Trtllm metric_labels. (#2666) · ef535edb
  Tzu-Ling Kan authored Aug 26, 2025
  
  ef535edb