Commits · cbe0b177abfd81688e045486d77c350e70fd3218 · OpenDAS / dynamo · GitLab

"lib/bindings/python/tests/cancellation/test_cancellation.py" did not exist on "6c539fbdacaa8d752695ca50e44fd2c96f04fdcc"

24 Oct, 2025 2 commits

refactor: redesign the metrics API from Trait to composition to make the code... · cbe0b177

Keiven C authored Oct 24, 2025


refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

cbe0b177

refactor: move engine configs out of components directory (#3772) · 8354d325
Anant Sharma authored Oct 24, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
```
8354d325

23 Oct, 2025 1 commit

feat: automatic profiling config generation (#3787) · a1b38af2

Hongkuan Zhou authored Oct 23, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

a1b38af2

22 Oct, 2025 7 commits

docs: address Harry/VDR feedback + fixing broken links across repository (#3802) · c6b59045

Anish authored Oct 22, 2025


Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

c6b59045

feat(operator): Refactor DGDR to use profiler's native configuration format (#3758) · eaf11e70
hhzhang16 authored Oct 22, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
eaf11e70
fix: bug fixes for planner tests (#3821) · 7b2f95e4
hhzhang16 authored Oct 22, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
7b2f95e4
docs: add Kubernetes deployment guidance to KV router documentation (#3828) · 21697e1c
Ben Hamm authored Oct 22, 2025
```
Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
```
21697e1c
docs: fix doc links (guide -> observability) (#3830) · 1aa5e92b
Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
1aa5e92b
feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
f93b619a
fix: gb200 nixl instructions and max cuda graph bs on h100 instructions (#3807) · 87ea346d
ishandhanani authored Oct 21, 2025

87ea346d

21 Oct, 2025 7 commits
- feat: remove deploy/utils rbac (#3771) · eb73c2b0
  hhzhang16 authored Oct 21, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eb73c2b0
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
- docs: Add cancellation docs for vLLM, TRT-LLM and SGLang backends (#3783) · 22d22777
  Jacky authored Oct 21, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  22d22777
- docs: Add version 0.6.0 to versions1.json (#3795) · 8ad3b9a2
  Kristen Kelleher authored Oct 21, 2025
```
Signed-off-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  8ad3b9a2
- chore: rm --enable-kvbm in docker build since KVBM is in by default (#3775) · b7c335a4
  Ziqi Fan authored Oct 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  b7c335a4
- feat: enable KVBM GPU offload to Disk bypassing CPU (#3510) · d5840cda
  Ziqi Fan authored Oct 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  d5840cda
- fix: fix the ooms in gb200 default instructions (#3768) · 2a24e4aa
  ishandhanani authored Oct 20, 2025
  
  2a24e4aa
20 Oct, 2025 3 commits
- fix: block_manager/disk - fix `fallocate` failure on some file systems (#2680) · 6ace46ce
  Dan Aloni authored Oct 21, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
```
  6ace46ce
- fix: update gb200 instructions and add a temp container tag (#3741) · a7fed329
  ishandhanani authored Oct 20, 2025
  
  a7fed329
- docs: Add KV Smart Router A/B Benchmarking Guide (#3696) · a665886a
  Ben Hamm authored Oct 20, 2025
```
Signed-off-by: Ben Hamm <bhamm@nvidia.com>
Co-authored-by: Ben Hamm <bhamm@bhamm-mlt.client.nvidia.com>
Co-authored-by: Ben Hamm <bhamm@nvidia.com>
```
  a665886a
17 Oct, 2025 5 commits

feat: add DGDR custom resource (#3489) · 57cdb9a1

Julien Mancuso authored Oct 17, 2025

Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

57cdb9a1

docs: briefly describe KV router limitations (#3716) · 4116e389
Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
4116e389
fix: standardize all planner ttft/itl units to float ms and fix docs (#3673) · ee56782b
William Arnold authored Oct 17, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
ee56782b

docs: Add Kvbm documentation for connector API integrations [DYN-1052] (#3578) · 7ead8b71

Suman Tatiraju authored Oct 17, 2025

Signed-off-by: Suman Tatiraju <statiraju@nvidia.com>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>

7ead8b71

docs: Adding elements required for version switcher (#3521) · 5fb661a5
Andrew Schilling authored Oct 17, 2025
```
Signed-off-by: Andrew Schilling <aschilling@nvidia.com>
```
5fb661a5

16 Oct, 2025 8 commits
- docs: reorganizing documentation to make things clearer (#3658) · 598cbbb7
  Anish authored Oct 16, 2025
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
```
  598cbbb7
- docs: move SGLang and vLLM Prometheus metrics documentation to docs path (#3677) · f4cd71f3
  Keiven C authored Oct 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f4cd71f3
- test: add durable consumer count test to CI using py-nats (#3669) · fdcc8d5b
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fdcc8d5b
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
- feat: Replace genai-perf with aiperf (#3533) · 9f310225
  Harshini Komali authored Oct 16, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  9f310225
- chore: move worker_monitor to the llm crate (#3667) · 7aa8e0e6
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7aa8e0e6
- fix: add `--host` to k8s and bump sgl version (#3666) · 9a002b30
  ishandhanani authored Oct 15, 2025
  
  9a002b30
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 4 commits
- chore: Mark NIXL as beta in TRTLLM (#3633) · 43d687e8
  Tanmay Verma authored Oct 15, 2025
```
Signed-off-by: Laikh Tewari <ltewari@nvidia.com>
Co-authored-by: Laikh Tewari <ltewari@nvidia.com>
```
  43d687e8
- feat: Replace genai-perf with aiperf in components/backends (#3528) · a7badb85
  Harshini Komali authored Oct 15, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  a7badb85
- feat: vllm data parallelism multi-node support in operator (#3595) · 8388e162
  Thomas Montfort authored Oct 15, 2025
  
  8388e162
- feat: support yaml config input for pre-deployment sweep script (#3622) · 400dceae
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  400dceae
14 Oct, 2025 3 commits
- chore: update sglang to 0.5.3.post1 to take advantage of container + doc cleanup (#3621) · c6e3db5e
  ishandhanani authored Oct 14, 2025
  
  c6e3db5e
- docs: Adding MDC to glossary (#3616) · 5744548b
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Kristen Kelleher <kkelleher@nvidia.com>
```
  5744548b
- feat: add pre-deployment check for storageclass (#3573) · 9bb2bc93
  Biswa Panda authored Oct 13, 2025
  
  9bb2bc93