Commits · 6ff49edbb7c77e41df04fe01779ed75a6a32a122 · OpenDAS / dynamo

01 Nov, 2025 1 commit
- feat: efficient serving of multiple mockers (#3997) · 6ff49edb
  Yan Ru Pei authored Oct 31, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6ff49edb
31 Oct, 2025 2 commits
- chore: KVBM pip wheel (#3826) · 6afa679c
  Richard Huo authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  6afa679c
- refactor: move backend deploy, launch and slurm files from components to examples (#3849) · 8bd37c96
  Anant Sharma authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8bd37c96
30 Oct, 2025 2 commits
- chore: bump nixl verison to 0.7.0 (#3936) · 1da9d70a
  Tushar Sharma authored Oct 30, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  1da9d70a
- feat: Add KV event consolidator for KVBM (vllm) and router integration (#3725) · 18986010
  Kris Hung authored Oct 30, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  18986010
29 Oct, 2025 1 commit
- fix: NIXL connect header strip (#3959) · da10299c
  milesial authored Oct 29, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  da10299c
28 Oct, 2025 4 commits
- feat: KVBM V2 Initial Migration (#3861) · 3998fdcb
  jthomson04 authored Oct 28, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  3998fdcb
- feat: mocker disagg (#3833) · cc4c3516
  Yan Ru Pei authored Oct 28, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cc4c3516
- feat: b64 encoding for nixl_connect metadata (#3843) · 76f2ef91
  milesial authored Oct 28, 2025
  
  76f2ef91
- chore(runtime): Do not expose etcd lease ID (#3915) · c78b5901
  Graham King authored Oct 28, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c78b5901
27 Oct, 2025 2 commits

feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass... · 0028cdf4

Kyle McGill authored Oct 27, 2025


feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass callback to enable cuda graphs (#3297)
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>

0028cdf4

chore: Update version to 0.6.1 (#3916) · 9bb1af33
Tushar Sharma authored Oct 27, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
9bb1af33

24 Oct, 2025 2 commits

refactor: redesign the metrics API from Trait to composition to make the code... · cbe0b177

Keiven C authored Oct 24, 2025


refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

cbe0b177

feat: python binding for kserve grpc frontend (#3739) · 9e5407f2

zhongdaor-nv authored Oct 24, 2025


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

9e5407f2

23 Oct, 2025 3 commits
- chore: Use KeyValueStoreManager instead of etcd::Client (#3822) · 7731b024
  Graham King authored Oct 23, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7731b024
- chore: restructure mocker cli args handling, to include prefill/decode (#3847) · 41ff394f
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  41ff394f
- refactor: kvbm modularity DIS-657 Eliminate ETCD from the leader-worker initialization (#3202) · 94aa2a7b
  Richard Huo authored Oct 23, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  94aa2a7b
22 Oct, 2025 2 commits
- feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f93b619a
- feat: python gil release for radix tree + dump_tree_as_events in python (#3748) · 681951d4
  Michael Feil authored Oct 21, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  681951d4
21 Oct, 2025 4 commits
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
- fix: revert placement of logging init if otel exports is disabled (#3797) · 8a04d7b2
  mohammedabdulwahhab authored Oct 21, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  8a04d7b2
- feat: enable KVBM GPU offload to Disk bypassing CPU (#3510) · d5840cda
  Ziqi Fan authored Oct 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  d5840cda
- refactor(runtime): Replace std::sync::Mutex with parking_lot::Mutex (#3740) · 9ae98ed7
  Graham King authored Oct 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9ae98ed7
20 Oct, 2025 2 commits
- chore: Replace ServiceConfigBuilder with add_stats_service (#3736) · f6ed01b1
  Graham King authored Oct 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f6ed01b1
- feat: python package build with abi (cross py3.10+) (#3571) · af7b73c0
  Michael Feil authored Oct 20, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  af7b73c0
18 Oct, 2025 1 commit
- feat: add prefill workers to discovery (#3709) · 4b7a806c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b7a806c
17 Oct, 2025 1 commit
- chore: remove kv metrics scraping and aggregation (#3701) · 4c207e0c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c207e0c
16 Oct, 2025 4 commits
- docs: reorganizing documentation to make things clearer (#3658) · 598cbbb7
  Anish authored Oct 16, 2025
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
```
  598cbbb7
- fix: mocker engines should ignore downloading weights from hf (again) (#3664) · ae4e96a2
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ae4e96a2
- feat: Enable cancellation during or before a stream is established (#3635) · 734d2f87
  Jacky authored Oct 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  734d2f87
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 2 commits
- fix: avoid offload redundant prefill blocks | fix cuda graph hanging (#3632) · f5854e17
  Ziqi Fan authored Oct 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  f5854e17
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
13 Oct, 2025 3 commits
- chore: pre-0.6.0 activities (#3592) · cd2389ba
  Harrison Saturley-Hall authored Oct 13, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  cd2389ba
- feat: remove stale workers on snapshot + some refactoring (#3589) · b5e762b2
  Yan Ru Pei authored Oct 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b5e762b2
- feat: OTEL Exporter and Tempo Visualization (#3307) · 1f92dd54
  mohammedabdulwahhab authored Oct 13, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1f92dd54
12 Oct, 2025 1 commit
- chore: bump vllm to 0.11.0 (#3422) · 90dc7589
  Alec authored Oct 12, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  90dc7589
11 Oct, 2025 3 commits
- chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  c3fcfdd6
- feat: implement custom backend metrics for NIM (#3266) · 65cc5337
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  65cc5337
- feat: rm the old KVBM metrics | update G2 to G3 metrics collection (#3561) · 4224e57d
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  4224e57d