Commits · cb3dc244bbf9b7f593b4ad5b59bfdaa0ea5ddb7f · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "2ae9ab9f7cebafb9692add9ed962a0a577ba28f2"

25 Sep, 2025 1 commit
- feat: updated error schema (#3210) · cb3dc244
  Ayush Agarwal authored Sep 25, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  cb3dc244
24 Sep, 2025 5 commits
- chore: bump versions ahead of 0.5.1 release (#3209) · 980727bb
  Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  980727bb
- feat: modelexpress dynamo integration (#3191) · da3b1dbd
  Hyunjae Woo authored Sep 24, 2025
  
  da3b1dbd
- feat: add NIM FE (num_request_max) + runtime config metrics with periodic polling (#3107) · 116b9b43
  Keiven C authored Sep 24, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  116b9b43
- chore: jail stream optimizations (v1) (#3195) · 2ae20102
  Ayush Agarwal authored Sep 24, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2ae20102
- feat: tensor type for generic inference. (#2746) · 6ba64c31
  GuanLuo authored Sep 24, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6ba64c31
23 Sep, 2025 3 commits
- feat: JailedStream (#3034) · c63cceaa
  Ryan Olson authored Sep 23, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c63cceaa
- chore: added middleware layer to catch json validation errors (#3182) · 4c56c8ae
  Ayush Agarwal authored Sep 23, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4c56c8ae
- fix: FullyContiguous Memory Region Size Bug (#3175) · 13a5d61b
  Olga Andreeva authored Sep 23, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  13a5d61b
22 Sep, 2025 2 commits

feat: vllm prefill router (#3155) · 031590fc
Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
031590fc

refactor: PyTest subprocess for cancellation unit tests (#3127) · 31c78df7

Jacky authored Sep 22, 2025


Signed-off-by: michaelfeil <me@michaelfeil.eu>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: michaelfeil <me@michaelfeil.eu>

31c78df7

19 Sep, 2025 7 commits
- chore: Upgrade Rust to 1.90 (#3147) · 7a5a0bd6
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7a5a0bd6
- feat: add granite class of reasoning parser (#2936) · 0e63cd9c
  nachiketb-nvidia authored Sep 19, 2025
```
Signed-off-by: nachiketb <nachiketb@nvidia.com>
```
  0e63cd9c
- feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b
  Yan Ru Pei authored Sep 19, 2025
```
feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5b19a39b
- feat: Port vllm port allocator to Rust in bindings (#3125) · 3865a941
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  3865a941
- feat: KVBM connector : enabling vectorized copy from pinned memory to device... · 2d39f1b1
  Olga Andreeva authored Sep 19, 2025
```
feat: KVBM connector : enabling vectorized copy from pinned memory to device memory and vice versa (#2989)
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>
```
  2d39f1b1
- feat: Convert message[content] from list to string. (#3067) · 5abea1be
  KrishnanPrash authored Sep 19, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  5abea1be
- feat: Request Cancellation unary request support (#3004) · a8fd1271
  Jacky authored Sep 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  a8fd1271
18 Sep, 2025 5 commits
- feat: enhance GPT OSS frontend with improved harmony tool calling parser and... · 6675bfc8
  zhongdaor-nv authored Sep 18, 2025
```
feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  6675bfc8
- feat: add finish reason = tool_calls for stream=False and phi-4 detect token start fix (#3087) · 31f5ed3c
  Elyas Mehtabuddin authored Sep 18, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
```
  31f5ed3c
- fix: incorrect crate SPDX identifier, Apache-2.0 (#3118) · dcf55c3c
  Harrison Saturley-Hall authored Sep 18, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  dcf55c3c
- chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
  Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b6595e24
- chore: set default tool calling behaviour to be disabled (#3096) · 37322011
  Ayush Agarwal authored Sep 17, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  37322011
17 Sep, 2025 10 commits
- fix: Update the KVBM <> TRT-LLM integration interface to match the latest... · 86ce03f4
  Richard Huo authored Sep 17, 2025
```
fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  86ce03f4
- fix: harmony parser streaming fix (#3074) · cd814377
  Ayush Agarwal authored Sep 17, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  cd814377
- fix: hook up worker removals for indexer (#3095) · 78a3feda
  Yan Ru Pei authored Sep 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  78a3feda
- chore(bindings): Remove NatsQueue (#3086) · f88d7dc7
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f88d7dc7
- chore: fillout sampling params (seed, n, best_of, min_p) (#3055) · 3de04dd9
  Greg Clark authored Sep 17, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  3de04dd9
- feat: add chat_template_kwargs param to v1/chat/completion (#3016) · eb6722e3
  Chi McIsaac authored Sep 17, 2025
```
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
```
  eb6722e3
- feat: Make part of discovery re-usable (#3073) · 9060ce12
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9060ce12
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1
- feat: make connect_with_reset jetstream configurable (#3078) · 7ce8d0ef
  Michael Feil authored Sep 16, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  7ce8d0ef
- fix: purge before snapshotting (#3077) · d49fc3eb
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d49fc3eb
16 Sep, 2025 7 commits
- feat: kv commit router (#3024) · 0373b897
  Michael Feil authored Sep 16, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  0373b897
- fix: replace hard coded dynamo namespace with env var (#3048) · 960dc896
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  960dc896
- chore(llm): Remove extra license headers (#3065) · bc0a7633
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bc0a7633
- chore: Remove more extended Apache headers (#3063) · 723f2da7
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  723f2da7
- fix: Interactive inputs actually stops, does not ignore stop token (#3057) · 87e6e052
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87e6e052
- feat: add HTTP queue metrics for NIM frontend request tracking (#2914) · 9fa5450c
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9fa5450c
- chore(runtime): Shorten the license header (#3059) · 02a22cbc
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  02a22cbc