Commits · 481bf395ce8221ee5efdd940ef0ead8b5466a6f5 · OpenDAS / dynamo

"lib/bindings/python/vscode:/vscode.git/clone" did not exist on "ffe206297d73d1ae7eba5b524b1d6b95f17fa633"

29 Sep, 2025 3 commits
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
- feat: enable KVBM emit metrics in Dynamo TRTLLM (#3254) · e21dcf6c
  Ziqi Fan authored Sep 29, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  e21dcf6c
- feat: enable parallel tool calling and add testing (#3188) · 67e1f6ee
  Elyas Mehtabuddin authored Sep 29, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  67e1f6ee
26 Sep, 2025 3 commits

chore: Remove etcd from python bindings (#3238) · 7ebbd001
Graham King authored Sep 26, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
7ebbd001

chore: bump vllm version to 0.10.2 (#3180) · 5bb74904

Alec authored Sep 26, 2025


Signed-off-by: Alec <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>

5bb74904

feat: Add distributed tracing context support to Python bindings (#3160) · f2e2e935

Neelay Shah authored Sep 25, 2025


Signed-off-by: nnshah1 <neelays@nvidia.com>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>

f2e2e935

25 Sep, 2025 1 commit
- chore: Migrate planner virtual_connector internals into bindings (#3205) · c03e2f6b
  Graham King authored Sep 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c03e2f6b
24 Sep, 2025 2 commits

chore: bump versions ahead of 0.5.1 release (#3209) · 980727bb
Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
980727bb

feat: tensor type for generic inference. (#2746) · 6ba64c31

GuanLuo authored Sep 24, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6ba64c31

23 Sep, 2025 1 commit
- feat: JailedStream (#3034) · c63cceaa
  Ryan Olson authored Sep 23, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c63cceaa
22 Sep, 2025 2 commits

feat: vllm prefill router (#3155) · 031590fc
Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
031590fc

refactor: PyTest subprocess for cancellation unit tests (#3127) · 31c78df7

Jacky authored Sep 22, 2025


Signed-off-by: michaelfeil <me@michaelfeil.eu>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: michaelfeil <me@michaelfeil.eu>

31c78df7

19 Sep, 2025 5 commits

chore: Upgrade Rust to 1.90 (#3147) · 7a5a0bd6
Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
7a5a0bd6

feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b

Yan Ru Pei authored Sep 19, 2025


feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

5b19a39b

feat: Port vllm port allocator to Rust in bindings (#3125) · 3865a941
Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
3865a941

feat: KVBM connector : enabling vectorized copy from pinned memory to device... · 2d39f1b1

Olga Andreeva authored Sep 19, 2025

feat: KVBM connector : enabling vectorized copy from pinned memory to device memory and vice versa (#2989)
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>

2d39f1b1

feat: Request Cancellation unary request support (#3004) · a8fd1271
Jacky authored Sep 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
a8fd1271

18 Sep, 2025 2 commits
- feat: add finish reason = tool_calls for stream=False and phi-4 detect token start fix (#3087) · 31f5ed3c
  Elyas Mehtabuddin authored Sep 18, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
```
  31f5ed3c
- chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
  Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b6595e24
17 Sep, 2025 5 commits
- fix: Update the KVBM <> TRT-LLM integration interface to match the latest... · 86ce03f4
  Richard Huo authored Sep 17, 2025
```
fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  86ce03f4
- fix: hook up worker removals for indexer (#3095) · 78a3feda
  Yan Ru Pei authored Sep 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  78a3feda
- chore(bindings): Remove NatsQueue (#3086) · f88d7dc7
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f88d7dc7
- feat: Make part of discovery re-usable (#3073) · 9060ce12
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9060ce12
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1
16 Sep, 2025 4 commits
- fix: replace hard coded dynamo namespace with env var (#3048) · 960dc896
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  960dc896
- chore: Remove more extended Apache headers (#3063) · 723f2da7
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  723f2da7
- fix: Interactive inputs actually stops, does not ignore stop token (#3057) · 87e6e052
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87e6e052
- chore: add additional param support for multimodal models (#3042) · 435803ea
  ryan-lempka authored Sep 16, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  435803ea
15 Sep, 2025 2 commits
- fix: early stop if CPU or disk space not set when using KVBM (#2997) · 55659eae
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  55659eae
- fix: change KVBM Connector build_connector_meta due to vLLM ToT change (#2887) · bd835b03
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  bd835b03
11 Sep, 2025 1 commit
- ci: fix completions race (#3010) · c8ecc402
  Alec authored Sep 11, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  c8ecc402
10 Sep, 2025 2 commits
- feat: adds kv indexer metrics (#2905) · 40000976
  blarson-b10 authored Sep 10, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  40000976
- docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
  Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  de5ab2c4
09 Sep, 2025 1 commit
- feat: Add a checksum to ModelDeploymentCard fields (#2934) · 6f14e941
  Graham King authored Sep 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6f14e941
05 Sep, 2025 1 commit
- fix: Load the tokenizer JSON once for chat and completions. (#2910) · cb5a657a
  Graham King authored Sep 05, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cb5a657a
03 Sep, 2025 4 commits

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

feat: Add --custom-jinja-template argument to pass a custom chat template for vLLM (#2829) · c920cbd9
KrishnanPrash authored Sep 03, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
c920cbd9
feat: dynamo namespace isolation (#2394) · c6becbc8
Biswa Panda authored Sep 03, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
c6becbc8
feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
383e3b3a

02 Sep, 2025 1 commit
- feat: added parser name bindings (#2808) · 87a721a8
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  87a721a8