Commits · 9975cb9ffe6c6c644b6e7047df810a0db1c58a52 · OpenDAS / dynamo

"deploy/cloud/vscode:/vscode.git/clone" did not exist on "2c2eb8f411e192b34f3ae7f52f0b0981a438bc1d"

08 Oct, 2025 5 commits
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- chore: Remove llama.cpp engine (#3499) · 0aa0768f
  Graham King authored Oct 08, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0aa0768f
- feat: DIS-678 kvbm modularity: standalone metrics endpoint (#3433) · cf83794a
  Richard Huo authored Oct 08, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  cf83794a
- chore: Remove GGUF support (#3488) · 1b1265e6
  Graham King authored Oct 08, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  1b1265e6
- feat: add Python MetricsRegistry Python metrics registration (#3341) · 0c4c4d1d
  Keiven C authored Oct 07, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0c4c4d1d
07 Oct, 2025 4 commits
- fix: Make planner VirtualConnectorClient also use v1/ prefix. (#3468) · bdad6f1a
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bdad6f1a
- feat: Connect DYN_LOG level to TLLM_LOG_LEVEL (#3451) · 68bbe8a9
  Tanmay Verma authored Oct 07, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  68bbe8a9
- feat(etcd): Version the etcd keys (#3458) · a5371bfc
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  a5371bfc
- chore(discovery): Watch/publish ModelDeploymentCard instead of ModelEntry (#3350) · 81162dfe
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  81162dfe
04 Oct, 2025 1 commit
- feat: use KvPushRouter for prefill router (#3401) · 30610e73
  Yan Ru Pei authored Oct 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  30610e73
02 Oct, 2025 1 commit
- fix: Adjust func signature to match main post-merge (#3357) · 91ba9026
  atchernych authored Oct 01, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  91ba9026
01 Oct, 2025 6 commits
- feat: Transition to FullyContiguous Host and Disk layouts (#3090) · d2e3b66e
  Olga Andreeva authored Oct 01, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>
```
  d2e3b66e
- feat: Create worker selection pipeline (#3080) · 5194acbd
  atchernych authored Oct 01, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  5194acbd
- fix: DIS-706 skip offloading the G1 matched blocks during offloading (#3299) · 713e9e48
  Richard Huo authored Oct 01, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  713e9e48
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
- refactor: standardize Prometheus metric naming conventions (part 1) (#3035) · f4a3a6b6
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f4a3a6b6
- feat: add Context class to Python type stubs (#3327) · af4c0cad
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  af4c0cad
30 Sep, 2025 3 commits

feat: python add abi compatability for cross-platform builds + add a unit test... · 5b457b70

Michael Feil authored Sep 30, 2025

feat: python add abi compatability for cross-platform builds + add a unit test to HttpServer (#3044)
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: root <root@michaelfeil2-dev-pod-b200-0.michaelfeil2-dev-pod-b200.baseten.svc.cluster.local>
Signed-off-by: root <root@michaelfeildns-dev-pod-h100-0.michaelfeildns-dev-pod-h100.baseten.svc.cluster.local>
Co-authored-by: root <root@michaelfeil2-dev-pod-b200-0.michaelfeil2-dev-pod-b200.baseten.svc.cluster.local>
Co-authored-by: root <root@michaelfeildns-dev-pod-h100-0.michaelfeildns-dev-pod-h100.baseten.svc.cluster.local>

5b457b70

fix: python bindings for router should register to etcd as well (#3302) · d354763c
Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
d354763c
feat: add Python const for Prometheus metric names (#3244) · cacac9b9
Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
cacac9b9

29 Sep, 2025 3 commits
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
- feat: enable KVBM emit metrics in Dynamo TRTLLM (#3254) · e21dcf6c
  Ziqi Fan authored Sep 29, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  e21dcf6c
- feat: enable parallel tool calling and add testing (#3188) · 67e1f6ee
  Elyas Mehtabuddin authored Sep 29, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  67e1f6ee
26 Sep, 2025 3 commits

chore: Remove etcd from python bindings (#3238) · 7ebbd001
Graham King authored Sep 26, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
7ebbd001

chore: bump vllm version to 0.10.2 (#3180) · 5bb74904

Alec authored Sep 26, 2025


Signed-off-by: Alec <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>

5bb74904

feat: Add distributed tracing context support to Python bindings (#3160) · f2e2e935

Neelay Shah authored Sep 25, 2025


Signed-off-by: nnshah1 <neelays@nvidia.com>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>

f2e2e935

25 Sep, 2025 1 commit
- chore: Migrate planner virtual_connector internals into bindings (#3205) · c03e2f6b
  Graham King authored Sep 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c03e2f6b
24 Sep, 2025 2 commits

chore: bump versions ahead of 0.5.1 release (#3209) · 980727bb
Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
980727bb

feat: tensor type for generic inference. (#2746) · 6ba64c31

GuanLuo authored Sep 24, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6ba64c31

23 Sep, 2025 1 commit
- feat: JailedStream (#3034) · c63cceaa
  Ryan Olson authored Sep 23, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c63cceaa
22 Sep, 2025 2 commits

feat: vllm prefill router (#3155) · 031590fc
Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
031590fc

refactor: PyTest subprocess for cancellation unit tests (#3127) · 31c78df7

Jacky authored Sep 22, 2025


Signed-off-by: michaelfeil <me@michaelfeil.eu>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: michaelfeil <me@michaelfeil.eu>

31c78df7

19 Sep, 2025 5 commits

chore: Upgrade Rust to 1.90 (#3147) · 7a5a0bd6
Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
7a5a0bd6

feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b

Yan Ru Pei authored Sep 19, 2025


feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

5b19a39b

feat: Port vllm port allocator to Rust in bindings (#3125) · 3865a941
Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
3865a941

feat: KVBM connector : enabling vectorized copy from pinned memory to device... · 2d39f1b1

Olga Andreeva authored Sep 19, 2025

feat: KVBM connector : enabling vectorized copy from pinned memory to device memory and vice versa (#2989)
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>

2d39f1b1

feat: Request Cancellation unary request support (#3004) · a8fd1271
Jacky authored Sep 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
a8fd1271

18 Sep, 2025 2 commits
- feat: add finish reason = tool_calls for stream=False and phi-4 detect token start fix (#3087) · 31f5ed3c
  Elyas Mehtabuddin authored Sep 18, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
```
  31f5ed3c
- chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
  Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b6595e24
17 Sep, 2025 1 commit

fix: Update the KVBM <> TRT-LLM integration interface to match the latest... · 86ce03f4

Richard Huo authored Sep 17, 2025


fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>

86ce03f4