Commits · 3c7ed61d05d153075b46d3a5e278c7d72c76f8e1 · OpenDAS / dynamo

22 Dec, 2025 1 commit
- fix: Truncate HttpError message to first 8192 characters (#5020) · ac8c9023
  Phillippe Siclait authored Dec 22, 2025
```
Signed-off-by: Phillippe Siclait <546332+siclait@users.noreply.github.com>
```
  ac8c9023
19 Dec, 2025 1 commit
- feat: add multimodal support to KV router with standalone trtllm example (#4577) · 481dc636
  zhongdaor-nv authored Dec 18, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  481dc636
11 Dec, 2025 1 commit
- test: Ensure Request Cancellation, Migration, Rejection Work with TCP transport (#4875) · 00f8615e
  Jacky authored Dec 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  00f8615e
09 Dec, 2025 1 commit

fix: add timeout to tests before lora to unblock (#4808) · 1e37c103

Keiven C authored Dec 08, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

1e37c103

06 Dec, 2025 1 commit
- test: add timeout for lora utils tests (#4781) · 5588d770
  Biswa Panda authored Dec 05, 2025
  
  5588d770
04 Dec, 2025 1 commit
- fix: skip HuggingFace download for non-llms (#4686) · 118323f2
  Neal Vaidya authored Dec 04, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  118323f2
21 Nov, 2025 2 commits
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- chore: parallelize planner profile tests + bindings test cleanup (#4532) · d821a8b9
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d821a8b9
19 Nov, 2025 2 commits
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
17 Nov, 2025 1 commit
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
10 Nov, 2025 1 commit
- fix: Extend add_tensor_model so that ModelDeploymentCard can be correctly picked up (#4169) · ec7af939
  zhongdaor-nv authored Nov 10, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  ec7af939
08 Nov, 2025 1 commit
- fix: refactor to use service discovery (#4092) · 09b26bf6
  mohammedabdulwahhab authored Nov 08, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  09b26bf6
07 Nov, 2025 1 commit
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
31 Oct, 2025 1 commit

chore: KVBM pip wheel (#3826) · 6afa679c

Richard Huo authored Oct 31, 2025


Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

6afa679c

22 Oct, 2025 1 commit
- feat: python gil release for radix tree + dump_tree_as_events in python (#3748) · 681951d4
  Michael Feil authored Oct 21, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  681951d4
17 Oct, 2025 1 commit
- chore: remove kv metrics scraping and aggregation (#3701) · 4c207e0c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c207e0c
16 Oct, 2025 2 commits
- feat: Enable cancellation during or before a stream is established (#3635) · 734d2f87
  Jacky authored Oct 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  734d2f87
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
08 Oct, 2025 1 commit
- feat: add Python MetricsRegistry Python metrics registration (#3341) · 0c4c4d1d
  Keiven C authored Oct 07, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0c4c4d1d
07 Oct, 2025 1 commit
- chore(discovery): Watch/publish ModelDeploymentCard instead of ModelEntry (#3350) · 81162dfe
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  81162dfe
30 Sep, 2025 1 commit

feat: python add abi compatability for cross-platform builds + add a unit test... · 5b457b70

Michael Feil authored Sep 30, 2025

feat: python add abi compatability for cross-platform builds + add a unit test to HttpServer (#3044)
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: root <root@michaelfeil2-dev-pod-b200-0.michaelfeil2-dev-pod-b200.baseten.svc.cluster.local>
Signed-off-by: root <root@michaelfeildns-dev-pod-h100-0.michaelfeildns-dev-pod-h100.baseten.svc.cluster.local>
Co-authored-by: root <root@michaelfeil2-dev-pod-b200-0.michaelfeil2-dev-pod-b200.baseten.svc.cluster.local>
Co-authored-by: root <root@michaelfeildns-dev-pod-h100-0.michaelfeildns-dev-pod-h100.baseten.svc.cluster.local>

5b457b70

24 Sep, 2025 1 commit

feat: tensor type for generic inference. (#2746) · 6ba64c31

GuanLuo authored Sep 24, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6ba64c31

22 Sep, 2025 1 commit

refactor: PyTest subprocess for cancellation unit tests (#3127) · 31c78df7

Jacky authored Sep 22, 2025


Signed-off-by: michaelfeil <me@michaelfeil.eu>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: michaelfeil <me@michaelfeil.eu>

31c78df7

19 Sep, 2025 2 commits
- feat: Port vllm port allocator to Rust in bindings (#3125) · 3865a941
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  3865a941
- feat: Request Cancellation unary request support (#3004) · a8fd1271
  Jacky authored Sep 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  a8fd1271
18 Sep, 2025 1 commit
- chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
  Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b6595e24
11 Sep, 2025 1 commit
- ci: fix completions race (#3010) · c8ecc402
  Alec authored Sep 11, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  c8ecc402
10 Sep, 2025 1 commit
- docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
  Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  de5ab2c4
02 Sep, 2025 2 commits
- feat: added parser name bindings (#2808) · 87a721a8
  Ayush Agarwal authored Sep 02, 2025
```
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
```
  87a721a8
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
30 Aug, 2025 1 commit
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
19 Aug, 2025 1 commit

feat: kvbm + connector (#2258) · 07cfc3a1

Ryan Olson authored Aug 19, 2025


Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: John Thompson <jothomson@nvidia.com>
Co-authored-by: Richard Huo <rihuo@nvidia.com>
Co-authored-by: Zicheng Ma <zichengm@nvidia.com>

07cfc3a1

15 Aug, 2025 1 commit
- fix: remove kvmanager feature from python 3.12 ai-dynamo-runtime wheel (#2456) · ffae72b7
  Harrison Saturley-Hall authored Aug 15, 2025
  
  ffae72b7
22 Jul, 2025 1 commit
- chore: Remove unused portion of kv bindings test (#2052) · 9f2356cb
  Ryan McCormick authored Jul 22, 2025
  
  9f2356cb
07 Jul, 2025 1 commit

feat: vllm speculative decoding metrics (#1549) · 439e977d

jain-ria authored Jul 07, 2025


Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

439e977d

01 Jul, 2025 1 commit
- feat: Approximate KV Routing (#1636) · aaf283bb
  jthomson04 authored Jun 30, 2025
  
  aaf283bb
14 Jun, 2025 1 commit

feat: Standalone Router (#1409) · 13a99b7f

Yan Ru Pei authored Jun 14, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: jain-ria <riajain@NVIDIA.com>

13a99b7f

30 May, 2025 1 commit
- refactor: rename KvMetricsPublisher to WorkerMetricsPublisher (#1284) · 2f8da9ad
  Alec authored May 30, 2025
  
  2f8da9ad