Commits · eb1c9f245cb0adf3aa0d06b3e3c43771c81d4120 · OpenDAS / dynamo

"lib/runtime/vscode:/vscode.git/clone" did not exist on "f6ed01b14c8caf0de4d90a05cb766c787a904af7"

04 Sep, 2025 5 commits
- fix: always enable graceful shutdown as migration is not set in sglang (#2865) · eb1c9f24
  Hongkuan Zhou authored Sep 04, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  eb1c9f24
- fix: Adding back runtime_config so that tool_parser work properly on … (#2855) · 9524a464
  zhongdaor-nv authored Sep 03, 2025
```
Co-authored-by: Zhongdao Ren <zhongdaor@ipp1-3309.ipp1a1.colossus.nvidia.com>
```
  9524a464
- refactor: refactor to be tree-based code + feat: framework check (#2799) · ab9d8f7b
  Keiven C authored Sep 03, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  ab9d8f7b
- chore: pass in mocker engine args directly in python cli + default frontend port to 8000 (#2853) · 3c7c1d64
  Yan Ru Pei authored Sep 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3c7c1d64
- chore: frontend API changes for thinking budget (#2848) · 8d30753f
  Bhuvan Agrawal authored Sep 03, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
```
  8d30753f
03 Sep, 2025 13 commits
- fix: dev target needs special permission, now VLLM version works for run.sh... · eb317cdf
  Keiven C authored Sep 03, 2025
```
fix: dev target needs special permission, now VLLM version works for run.sh and Dev Container (#2822)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  eb317cdf
- refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f
  Olga Andreeva authored Sep 03, 2025
```
refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  27fad26f
- feat: workaround for bitnami brownout (#2843) · b97db875
  julienmancuso authored Sep 03, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  b97db875
- feat: Add --custom-jinja-template argument to pass a custom chat template for vLLM (#2829) · c920cbd9
  KrishnanPrash authored Sep 03, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  c920cbd9
- feat: Metrics labels for multimodal. (#2835) · dea5f887
  Tzu-Ling Kan authored Sep 03, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  dea5f887
- fix: Example hello_world.py Context naming (#2833) · 8d54eb7e
  Jacky authored Sep 03, 2025
  
  8d54eb7e
- build: default to using dev instead of local-dev for vllm build (#2834) · e432ae4a
  Tushar Sharma authored Sep 03, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  e432ae4a
- feat: add deepseek_v3_1 tool parser with lib refactoring (#2832) · 5c197b39
  Ayush Agarwal authored Sep 03, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  5c197b39
- feat: dynamo namespace isolation (#2394) · c6becbc8
  Biswa Panda authored Sep 03, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  c6becbc8
- fix: indenting mistake missed condition. (#2825) · 6e073516
  Alec authored Sep 02, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  6e073516
- feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
  Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  383e3b3a
- chore: many bug fixes and improvements when testing planner (#2776) · 7da510cf
  Hongkuan Zhou authored Sep 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: hongkuan <hongkuanz@nvidia.com>
```
  7da510cf
- fix: Remove duplicate import and make logger global. (#2817) · 945a5729
  Tzu-Ling Kan authored Sep 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  945a5729
02 Sep, 2025 17 commits
- docs: add mention of deploy/utils quickstart to planner deployment docs (#2821) · a6e1d5fe
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a6e1d5fe
- docs: update profiling-related docs (#2816) · 7eef9ac3
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  7eef9ac3
- feat: Cleanup dynamo cloud installation documentation (#2807) · ad4821c5
  julienmancuso authored Sep 02, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  ad4821c5
- feat: added parser name bindings (#2808) · 87a721a8
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  87a721a8
- chore: bump version numbers ahead of 0.5.0 release (#2812) · 561ecb98
  Harrison Saturley-Hall authored Sep 02, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  561ecb98
- feat: Shutdown DRT when vLLM engine fails (#2698) · 432c5b13
  J Wyman authored Sep 02, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
```
  432c5b13
- fix: compile python regex once (#2810) · c2f0baa4
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c2f0baa4
- docs: SNS agg k8s example (#2773) · 42669baa
  kYLe authored Sep 02, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
```
  42669baa
- build: enable kvbm in vllm container (#2763) · 316e8844
  Anant Sharma authored Sep 02, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  316e8844
- fix: Do not apply chat template to completions (#2718) · 2422b83d
  Graham King authored Sep 02, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2422b83d
- feat: added support for harmony tool call parser (#2796) · 2c30e41f
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  2c30e41f
- refactor: Rewrite test_metrics_labels to use TRTLLMProcess. (#2794) · d83854b5
  Tzu-Ling Kan authored Sep 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d83854b5
- chore: add pydantic validation for benchmark profile config (#2791) · 882ae1b4
  Michael Shin authored Sep 02, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  882ae1b4
- fix: port forward to available ports when benchmarking (#2795) · 5bbbeae3
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  5bbbeae3
- feat: added support for pythonic tool parser (#2788) · d39d676b
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d39d676b
- feat: Add support for model express url injection (#2769) · 58d2699d
  julienmancuso authored Sep 02, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  58d2699d
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 4 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- fix: fix #2653: links of h100_prefill_performance.png and h100_decode_performance.png (#2650) · 3f09c395
  Jason Zhou authored Aug 30, 2025
  
  3f09c395
- feat: DIS-373 dynamo KVBM connector API integration with TRTLLM (#2544) · a68c2f8f
  Richard Huo authored Aug 29, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  a68c2f8f
- feat: add logits processor support for trtllm backend (#2702) · 43a26958
  Bhuvan Agrawal authored Aug 29, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  43a26958