Commits · 4000097653a9d6d345be96ff1466532a3a30f6f5 · OpenDAS / dynamo

"components/vscode:/vscode.git/clone" did not exist on "55e458d899ca8a52aa7ad00cb54fca630a63f292"

10 Sep, 2025 2 commits

feat: sglang multiple frontend slurm deployment scripts (#2623) · 4b3a2c1a

ishandhanani authored Sep 10, 2025


Signed-off-by: ishandhanani <ishandhanani@gmail.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>

4b3a2c1a

fix: dyn namespace scoping for trtllm (#2970) · 905c920b
Biswa Panda authored Sep 09, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
905c920b

09 Sep, 2025 5 commits
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
- docs: fix broken links (#2965) · 3ea3d59b
  nv-nmailhot authored Sep 09, 2025
  
  3ea3d59b
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
- feat: automatically setup and inject prometheus configuration (#2912) · 729b5fd5
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  729b5fd5
08 Sep, 2025 3 commits
- refactor: standardize e2e tests across 3 frameworks (#2827) · 93208162
  Alec authored Sep 08, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  93208162
- chore: add preference logic for using tool-call and reasoning parsers for sglang (#2922) · 4a73b3c6
  Ayush Agarwal authored Sep 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4a73b3c6
- fix: fix typo in multinode example (#2931) · 6441ed36
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  6441ed36
05 Sep, 2025 2 commits
- feat: add trtllm example with config (#2895) · 0d9c8994
  julienmancuso authored Sep 05, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  0d9c8994
- docs: change docs to default port 8000 (#2876) · 1995ef9a
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1995ef9a
04 Sep, 2025 3 commits
- fix: always enable graceful shutdown as migration is not set in sglang (#2865) · eb1c9f24
  Hongkuan Zhou authored Sep 04, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  eb1c9f24
- fix: Adding back runtime_config so that tool_parser work properly on … (#2855) · 9524a464
  zhongdaor-nv authored Sep 03, 2025
```
Co-authored-by: Zhongdao Ren <zhongdaor@ipp1-3309.ipp1a1.colossus.nvidia.com>
```
  9524a464
- chore: pass in mocker engine args directly in python cli + default frontend port to 8000 (#2853) · 3c7c1d64
  Yan Ru Pei authored Sep 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3c7c1d64
03 Sep, 2025 5 commits

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

feat: Add --custom-jinja-template argument to pass a custom chat template for vLLM (#2829) · c920cbd9
KrishnanPrash authored Sep 03, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
c920cbd9
feat: dynamo namespace isolation (#2394) · c6becbc8
Biswa Panda authored Sep 03, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
c6becbc8
fix: indenting mistake missed condition. (#2825) · 6e073516
Alec authored Sep 02, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
6e073516
chore: many bug fixes and improvements when testing planner (#2776) · 7da510cf
Hongkuan Zhou authored Sep 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: hongkuan <hongkuanz@nvidia.com>
```
7da510cf

02 Sep, 2025 5 commits
- feat: added parser name bindings (#2808) · 87a721a8
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  87a721a8
- feat: Shutdown DRT when vLLM engine fails (#2698) · 432c5b13
  J Wyman authored Sep 02, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
```
  432c5b13
- feat: added support for harmony tool call parser (#2796) · 2c30e41f
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  2c30e41f
- refactor: Rewrite test_metrics_labels to use TRTLLMProcess. (#2794) · d83854b5
  Tzu-Ling Kan authored Sep 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d83854b5
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
30 Aug, 2025 2 commits

feat: add logits processor support for trtllm backend (#2702) · 43a26958

Bhuvan Agrawal authored Aug 29, 2025


Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

43a26958

feat: add benchmarking guide (#2620) · 699996e4
hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
699996e4

29 Aug, 2025 3 commits
- chore: add more reasoning and tool call parsers explicitly, remove unecessary files (#2785) · 295964e3
  nachiketb-nvidia authored Aug 29, 2025
```
Signed-off-by: nachiketb <nachiketb@nvidia.com>
```
  295964e3
- feat: Add Encode Worker and NIXL support to trtllm multimodal flow (#2452) · 781fa062
  Indrajit Bhosale authored Aug 29, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  781fa062
- fix: [trtllm] add wait_for_instance before register_llm (#2683) · 8c2072cf
  Alec authored Aug 28, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  8c2072cf
28 Aug, 2025 1 commit

feat: add reference setup for dynamo logging in k8s with loki (#2699) · 700d345d

mohammedabdulwahhab authored Aug 27, 2025


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

700d345d

27 Aug, 2025 2 commits
- feat: Sglang metrics labels. (#2679) · bad5d122
  Tzu-Ling Kan authored Aug 27, 2025
  
  bad5d122
- feat: Trtllm metric_labels. (#2666) · ef535edb
  Tzu-Ling Kan authored Aug 26, 2025
  
  ef535edb
26 Aug, 2025 4 commits
- feat: add and enable reasoning and tool parser flags for trtllm and sglang (#2713) · 8064849b
  nachiketb-nvidia authored Aug 26, 2025
  
  8064849b
- fix: sglang -- queue requests until model registration completes (#2701) · dfda6205
  hhzhang16 authored Aug 26, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  dfda6205
- fix: fix sglang multinode example (#2716) · 36df35e4
  julienmancuso authored Aug 26, 2025
  
  36df35e4
- docs: Update how containers should be built for SGLang examples (#2707) · 5d177b61
  Yunzhou Liu authored Aug 26, 2025
  
  5d177b61
25 Aug, 2025 2 commits
- docs: Simplify sphinx build and table of contents on webpage (#2519) · 766d3f2c
  Ryan McCormick authored Aug 25, 2025
  
  766d3f2c
- feat: enable --dyn-reasoning-parser flag to set reasoning parser for vllm deployments (#2700) · f5a41004
  nachiketb-nvidia authored Aug 25, 2025
  
  f5a41004
22 Aug, 2025 1 commit
- fix: [TRTLLM+ LLAMA4 + Eagle 3] Remove the ‘two-models config’ and set the... · 0bd4995d
  Richard Huo authored Aug 22, 2025
```
fix: [TRTLLM+ LLAMA4 + Eagle 3] Remove the ‘two-models config’ and set the ‘one-model’ solution as the default (#2661)
```
  0bd4995d