Commits · fed53137611b5af9ffc26a3c594c61e4adcb024c · OpenDAS / dynamo · GitLab

09 Sep, 2025 5 commits
- fix: metrics test to match actual namespace sanitization behavior (#2868) · fed53137
  Keiven C authored Sep 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  fed53137
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- fix: aggregate logprobs (#2928) · 8e4ae22b
  Greg Clark authored Sep 09, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  8e4ae22b
- chore: added tool call schema validation in oai formatter (#2935) · c319aa2d
  Ayush Agarwal authored Sep 09, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c319aa2d
- feat: Add a checksum to ModelDeploymentCard fields (#2934) · 6f14e941
  Graham King authored Sep 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6f14e941
08 Sep, 2025 2 commits
- chore: added utility to detect possible tool call start for a chunk (#2923) · b929e134
  Ayush Agarwal authored Sep 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  b929e134
- fix: fix hermes tool call config (#2915) · f93a7cad
  Ayush Agarwal authored Sep 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  f93a7cad
05 Sep, 2025 5 commits
- fix: Load the tokenizer JSON once for chat and completions. (#2910) · cb5a657a
  Graham King authored Sep 05, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cb5a657a
- refactor: Refactor discovery ModelManager to use `parking_lot::RwLock` (#2902) · 8065fe12
  Paul Hendricks authored Sep 05, 2025
```
Signed-off-by: Paul Hendricks <phendricks@nvidia.com>
```
  8065fe12
- feat: kvbm transfer context v2 (dis-598) (#2873) · 85b3dd44
  Ryan Olson authored Sep 04, 2025
```
Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>
```
  85b3dd44
- feat: Router benchmarking (#2828) · 94f100bc
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  94f100bc
- docs: change docs to default port 8000 (#2876) · 1995ef9a
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1995ef9a
04 Sep, 2025 4 commits
- fix: reduce nats stats query frequency (#2847) · 4df2e2d6
  Keiven C authored Sep 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  4df2e2d6
- fix: router slot manager needs force expire requests (#2840) · 307d4039
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  307d4039
- chore: pass in mocker engine args directly in python cli + default frontend port to 8000 (#2853) · 3c7c1d64
  Yan Ru Pei authored Sep 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3c7c1d64
- chore: frontend API changes for thinking budget (#2848) · 8d30753f
  Bhuvan Agrawal authored Sep 03, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
```
  8d30753f
03 Sep, 2025 6 commits
- refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f
  Olga Andreeva authored Sep 03, 2025
```
refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  27fad26f
- feat: Add --custom-jinja-template argument to pass a custom chat template for vLLM (#2829) · c920cbd9
  KrishnanPrash authored Sep 03, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  c920cbd9
- feat: add deepseek_v3_1 tool parser with lib refactoring (#2832) · 5c197b39
  Ayush Agarwal authored Sep 03, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  5c197b39
- feat: dynamo namespace isolation (#2394) · c6becbc8
  Biswa Panda authored Sep 03, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  c6becbc8
- feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
  Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  383e3b3a
- chore: many bug fixes and improvements when testing planner (#2776) · 7da510cf
  Hongkuan Zhou authored Sep 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: hongkuan <hongkuanz@nvidia.com>
```
  7da510cf
02 Sep, 2025 7 commits
- feat: added parser name bindings (#2808) · 87a721a8
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  87a721a8
- chore: bump version numbers ahead of 0.5.0 release (#2812) · 561ecb98
  Harrison Saturley-Hall authored Sep 02, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  561ecb98
- fix: compile python regex once (#2810) · c2f0baa4
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c2f0baa4
- fix: Do not apply chat template to completions (#2718) · 2422b83d
  Graham King authored Sep 02, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2422b83d
- feat: added support for harmony tool call parser (#2796) · 2c30e41f
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  2c30e41f
- feat: added support for pythonic tool parser (#2788) · d39d676b
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d39d676b
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 3 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- feat: DIS-373 dynamo KVBM connector API integration with TRTLLM (#2544) · a68c2f8f
  Richard Huo authored Aug 29, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  a68c2f8f
- feat: add logits processor support for trtllm backend (#2702) · 43a26958
  Bhuvan Agrawal authored Aug 29, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  43a26958
29 Aug, 2025 4 commits
- chore: add more reasoning and tool call parsers explicitly, remove unecessary files (#2785) · 295964e3
  nachiketb-nvidia authored Aug 29, 2025
```
Signed-off-by: nachiketb <nachiketb@nvidia.com>
```
  295964e3
- chore: added include_stop_str_in_output (#2782) · 1f6b83be
  Ayush Agarwal authored Aug 29, 2025
  
  1f6b83be
- feat: add Prometheus metrics integration for KvStats (#2704) · 15539fd0
  Keiven C authored Aug 28, 2025
```
Signed-off-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  15539fd0
- chore: deprecate nvext.top_k and nvext.repetition_penalty and make available top level (#2767) · 63f5bbc0
  ryan-lempka authored Aug 28, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  63f5bbc0
28 Aug, 2025 3 commits
- feat: Prevent double-tokenization when EPP picks worker (#2559) · 7d13b6e3
  atchernych authored Aug 28, 2025
  
  7d13b6e3
- feat: Integrate Model Express Client into Dynamo Model Downloads (#2574) · 95ce83d5
  KavinKrishnan authored Aug 28, 2025
```
Signed-off-by: Kavin Krishnan <kavink@nvidia.com>
Co-authored-by: KavinKrishnan <kavin.krishnan@nvidia.com>
```
  95ce83d5
- fix: Added description to async-openai/Cargo.toml (#2761) · fee976a2
  Dmitry Tokarev authored Aug 28, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fee976a2