Commits · cfe74445fcd5440dd908214657d13d7254d1de5f · OpenDAS / dynamo

02 Oct, 2025 2 commits
- fix: correctly parse subcomponent in sla-planner + deploy/doc update (#3363) · cfe74445
  Hongkuan Zhou authored Oct 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cfe74445
- fix: add a note for users to use VSWA feature after 0.5.1 release (#3380) · 92b8fe07
  Richard Huo authored Oct 02, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  92b8fe07
01 Oct, 2025 3 commits
- feat: restructure source code for python packaging (#3201) · 836d7417
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  836d7417
- feat: Add vLLM compilation cache to Dynamo Operator (#3257) · fcc42624
  Michael Shin authored Oct 01, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fcc42624
- feat: Add --custom-jinja-template argument to pass a custom chat template for TRTLLM (#3332) · b5782fcd
  KrishnanPrash authored Sep 30, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b5782fcd
30 Sep, 2025 4 commits
- refactor: Simplify TRT-LLM request abort calling logic (#3296) · 87190db0
  Jacky authored Sep 30, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  87190db0
- fix: Install right versions of the dependencies for tensorrtllm (#3218) · c265cd67
  Tanmay Verma authored Sep 30, 2025
  
  c265cd67
- refactor: standardize HF_CACHE to HF_HOME across codebase (use Hugging Face convention) (#3310) · 481bf395
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  481bf395
- fix: fix backend in trtllm multinode example (#3311) · 50dfd3af
  Julien Mancuso authored Sep 30, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  50dfd3af
29 Sep, 2025 2 commits
- feat: use python3 in all examples (#3259) · a01b7992
  Julien Mancuso authored Sep 29, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  a01b7992
- feat: add subComponentType in DGD API and uptake in planner (#3200) · 1a5016b0
  Thomas Montfort authored Sep 29, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  1a5016b0
26 Sep, 2025 2 commits
- feat: Request Cancellation TRT-LLM (#3193) · 77e66ae5
  Jacky authored Sep 26, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  77e66ae5
- docs: remove prebuilt TRT-LLM requirement in gpt-oss guide (#3234) · da7d1a33
  GuanLuo authored Sep 26, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  da7d1a33
24 Sep, 2025 2 commits
- fix: update the tags for consistency and remove 0.4.1 refs (#3058) · 9e8f67ed
  Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9e8f67ed
- feat: add NIM FE (num_request_max) + runtime config metrics with periodic polling (#3107) · 116b9b43
  Keiven C authored Sep 24, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  116b9b43
23 Sep, 2025 3 commits
- feat: add trtllm and vllm multinode k8s examples (#3100) · 37bc8444
  Julien Mancuso authored Sep 23, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  37bc8444
- feat: revamp kubernetes doc (#3173) · 4a718028
  Julien Mancuso authored Sep 23, 2025
```
Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  4a718028
- feat: Trtllm health check payload use bos_token_id (#3145) · 7b43b3a5
  Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  7b43b3a5
19 Sep, 2025 1 commit
- fix: small planner manifest/doc fixes (#3129) · 7d2fc13e
  Thomas Montfort authored Sep 19, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  7d2fc13e
18 Sep, 2025 1 commit
- chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
  Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b6595e24
17 Sep, 2025 4 commits
- fix: Update the KVBM <> TRT-LLM integration interface to match the latest... · 86ce03f4
  Richard Huo authored Sep 17, 2025
```
fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  86ce03f4
- feat: Trtllm canary health check (#3082) · 67ff181d
  Tzu-Ling Kan authored Sep 17, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  67ff181d
- fix: resolve token loss bug in final packet (#2985) · 045b61dd
  Xuwei authored Sep 17, 2025
```
Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>
```
  045b61dd
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1
16 Sep, 2025 1 commit
- fix: move deep_update function to trtllm folder (#3070) · 2bb1b268
  Hongkuan Zhou authored Sep 16, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2bb1b268
10 Sep, 2025 2 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

fix: dyn namespace scoping for trtllm (#2970) · 905c920b
Biswa Panda authored Sep 09, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
905c920b

09 Sep, 2025 3 commits
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
- docs: fix broken links (#2965) · 3ea3d59b
  nv-nmailhot authored Sep 09, 2025
  
  3ea3d59b
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
05 Sep, 2025 1 commit
- feat: add trtllm example with config (#2895) · 0d9c8994
  julienmancuso authored Sep 05, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  0d9c8994
04 Sep, 2025 1 commit
- fix: Adding back runtime_config so that tool_parser work properly on … (#2855) · 9524a464
  zhongdaor-nv authored Sep 03, 2025
```
Co-authored-by: Zhongdao Ren <zhongdaor@ipp1-3309.ipp1a1.colossus.nvidia.com>
```
  9524a464
03 Sep, 2025 1 commit

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

02 Sep, 2025 3 commits
- feat: added parser name bindings (#2808) · 87a721a8
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  87a721a8
- feat: added support for harmony tool call parser (#2796) · 2c30e41f
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  2c30e41f
- refactor: Rewrite test_metrics_labels to use TRTLLMProcess. (#2794) · d83854b5
  Tzu-Ling Kan authored Sep 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d83854b5
30 Aug, 2025 1 commit

feat: add logits processor support for trtllm backend (#2702) · 43a26958

Bhuvan Agrawal authored Aug 29, 2025


Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

43a26958

29 Aug, 2025 3 commits
- chore: add more reasoning and tool call parsers explicitly, remove unecessary files (#2785) · 295964e3
  nachiketb-nvidia authored Aug 29, 2025
```
Signed-off-by: nachiketb <nachiketb@nvidia.com>
```
  295964e3
- feat: Add Encode Worker and NIXL support to trtllm multimodal flow (#2452) · 781fa062
  Indrajit Bhosale authored Aug 29, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  781fa062
- fix: [trtllm] add wait_for_instance before register_llm (#2683) · 8c2072cf
  Alec authored Aug 28, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  8c2072cf