Commits · d809906e62840e5a566c69bb364ececf56dba11b · OpenDAS / dynamo

"lib/vscode:/vscode.git/clone" did not exist on "6b67c1c4bfe31ec831718b79fc3cb0c2ee96481d"

07 Oct, 2025 1 commit
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
06 Oct, 2025 2 commits

chore: added vllm tool + reasoning data (#3416) · d4b09631
Ayush Agarwal authored Oct 06, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
d4b09631

test: Add per-worker routing and KV event synchronization test + minor... · 2160b913

Paul Li authored Oct 06, 2025

test: Add per-worker routing and KV event synchronization test + minor subscriber worker_id parsing fix (#3426)
Signed-off-by: Paul Li <zhixiong2008@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

2160b913

04 Oct, 2025 1 commit
- feat: use KvPushRouter for prefill router (#3401) · 30610e73
  Yan Ru Pei authored Oct 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  30610e73
03 Oct, 2025 1 commit
- fix: namespace not being considered on model delete (#3403) · c7cdc8cd
  Chi McIsaac authored Oct 03, 2025
```
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
```
  c7cdc8cd
01 Oct, 2025 6 commits
- feat: Transition to FullyContiguous Host and Disk layouts (#3090) · d2e3b66e
  Olga Andreeva authored Oct 01, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>
```
  d2e3b66e
- fix: Polling from exhausted stream in preprocessor (#3349) · a5e1d45e
  Jacky authored Oct 01, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  a5e1d45e
- feat: reasoning parser transformation (#3295) · 2a2bf58a
  Ayush Agarwal authored Oct 01, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2a2bf58a
- fix: DIS-706 skip offloading the G1 matched blocks during offloading (#3299) · 713e9e48
  Richard Huo authored Oct 01, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  713e9e48
- fix: null tools processing via minijinja (#3340) · 23e79552
  Ayush Agarwal authored Oct 01, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  23e79552
- refactor: standardize Prometheus metric naming conventions (part 1) (#3035) · f4a3a6b6
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f4a3a6b6
30 Sep, 2025 5 commits
- fix: Edge cases for Parallel tool calling (#3283) · 9088e1b5
  Elyas Mehtabuddin authored Sep 30, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
```
  9088e1b5
- feat: add audit logging for chat completions (#3062) · 56d20f53
  ryan-lempka authored Sep 30, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  56d20f53
- chore: Add Key abstraction in our KeyValueStore (#3322) · 50cdae5f
  Graham King authored Sep 30, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  50cdae5f
- fix: python bindings for router should register to etcd as well (#3302) · d354763c
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d354763c
- chore: Move model_input, model_type from ModelEntry to ModelDeploymentCard (#3292) · 6ffd20a8
  Graham King authored Sep 30, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6ffd20a8
29 Sep, 2025 4 commits
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
- chore: Remove revision from ModelDeploymentCard (#3293) · 97a98546
  Graham King authored Sep 29, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  97a98546
- chore: relaxing constraints on metadata field, adding metadata field to completions API (#3240) · 13156361
  nv-nedelman-1 authored Sep 29, 2025
```
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
```
  13156361
- feat: enable parallel tool calling and add testing (#3188) · 67e1f6ee
  Elyas Mehtabuddin authored Sep 29, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  67e1f6ee
26 Sep, 2025 3 commits

chore: added more api error code validations (#3231) · d4f0d2bc
Ayush Agarwal authored Sep 26, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
d4f0d2bc
feat: replace polling with event-driven metrics updates (#3207) · 53f3d2af
Keiven C authored Sep 26, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
53f3d2af

chore: bump vllm version to 0.10.2 (#3180) · 5bb74904

Alec authored Sep 26, 2025


Signed-off-by: Alec <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>

5bb74904

25 Sep, 2025 1 commit
- feat: updated error schema (#3210) · cb3dc244
  Ayush Agarwal authored Sep 25, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  cb3dc244
24 Sep, 2025 4 commits
- feat: modelexpress dynamo integration (#3191) · da3b1dbd
  Hyunjae Woo authored Sep 24, 2025
  
  da3b1dbd
- feat: add NIM FE (num_request_max) + runtime config metrics with periodic polling (#3107) · 116b9b43
  Keiven C authored Sep 24, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  116b9b43
- chore: jail stream optimizations (v1) (#3195) · 2ae20102
  Ayush Agarwal authored Sep 24, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2ae20102
- feat: tensor type for generic inference. (#2746) · 6ba64c31
  GuanLuo authored Sep 24, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6ba64c31
23 Sep, 2025 3 commits
- feat: JailedStream (#3034) · c63cceaa
  Ryan Olson authored Sep 23, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c63cceaa
- chore: added middleware layer to catch json validation errors (#3182) · 4c56c8ae
  Ayush Agarwal authored Sep 23, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4c56c8ae
- fix: FullyContiguous Memory Region Size Bug (#3175) · 13a5d61b
  Olga Andreeva authored Sep 23, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  13a5d61b
22 Sep, 2025 1 commit
- feat: vllm prefill router (#3155) · 031590fc
  Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  031590fc
19 Sep, 2025 5 commits

chore: Upgrade Rust to 1.90 (#3147) · 7a5a0bd6
Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
7a5a0bd6

feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b

Yan Ru Pei authored Sep 19, 2025


feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

5b19a39b

feat: KVBM connector : enabling vectorized copy from pinned memory to device... · 2d39f1b1

Olga Andreeva authored Sep 19, 2025

feat: KVBM connector : enabling vectorized copy from pinned memory to device memory and vice versa (#2989)
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>

2d39f1b1

feat: Convert message[content] from list to string. (#3067) · 5abea1be
KrishnanPrash authored Sep 19, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
5abea1be
feat: Request Cancellation unary request support (#3004) · a8fd1271
Jacky authored Sep 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
a8fd1271

18 Sep, 2025 3 commits
- feat: enhance GPT OSS frontend with improved harmony tool calling parser and... · 6675bfc8
  zhongdaor-nv authored Sep 18, 2025
```
feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  6675bfc8
- feat: add finish reason = tool_calls for stream=False and phi-4 detect token start fix (#3087) · 31f5ed3c
  Elyas Mehtabuddin authored Sep 18, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
```
  31f5ed3c
- chore: set default tool calling behaviour to be disabled (#3096) · 37322011
  Ayush Agarwal authored Sep 17, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  37322011