Commits · 037cc35d9c5b4d5ff5f08a1bf9a6642f51c7fc47 · OpenDAS / dynamo

11 Oct, 2025 1 commit
- feat: rm the old KVBM metrics | update G2 to G3 metrics collection (#3561) · 4224e57d
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  4224e57d
10 Oct, 2025 3 commits
- docs: Add tool calling usage guide (#2866) · c9da2bf8
  Ayush Agarwal authored Oct 10, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  c9da2bf8
- feat: add KVBM host to disk metrics | clean up dashboard (#3534) · ca674098
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  ca674098
- feat: add disk offloading filtering in KVBM (#3532) · b94ecd16
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  b94ecd16
09 Oct, 2025 1 commit
- docs: add vLLM KVBM 2P2D example due to a special ENV VAR to note (#3526) · 44012a24
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  44012a24
08 Oct, 2025 4 commits
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- chore: Remove llama.cpp engine (#3499) · 0aa0768f
  Graham King authored Oct 08, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0aa0768f
- feat: DIS-678 kvbm modularity: standalone metrics endpoint (#3433) · cf83794a
  Richard Huo authored Oct 08, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  cf83794a
- chore: Remove GGUF support (#3488) · 1b1265e6
  Graham King authored Oct 08, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  1b1265e6
03 Oct, 2025 1 commit

docs: add Planner Quickstart doc (#3358) · 89cf9107

hhzhang16 authored Oct 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

89cf9107

29 Sep, 2025 1 commit
- feat: enable KVBM emit metrics in Dynamo TRTLLM (#3254) · e21dcf6c
  Ziqi Fan authored Sep 29, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  e21dcf6c
25 Sep, 2025 1 commit
- docs: add start vllm + KVBM using dynamo into runbook (#3213) · c095bd85
  Ziqi Fan authored Sep 24, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  c095bd85
23 Sep, 2025 1 commit

feat: revamp kubernetes doc (#3173) · 4a718028

Julien Mancuso authored Sep 23, 2025


Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

4a718028

22 Sep, 2025 2 commits
- feat: replace Earthly (#2154) · 51b4cd7e
  Julien Mancuso authored Sep 22, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  51b4cd7e
- docs: Fixing Sphinx errors casued by structural problems (#3152) · 5fc0bf92
  Kristen Kelleher authored Sep 22, 2025
```
Signed-off-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>
```
  5fc0bf92
19 Sep, 2025 1 commit
- build: update trtllm to v1.1.0rc5 to enable trtllm + KVBM integration (#3119) · fb29bd5a
  Richard Huo authored Sep 19, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  fb29bd5a
18 Sep, 2025 1 commit
- feat(operator): mechanism for disabling imagePullSecrets discovery (#3092) · 70a8aa3f
  Thomas Montfort authored Sep 18, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  70a8aa3f
17 Sep, 2025 1 commit

fix: Update the KVBM <> TRT-LLM integration interface to match the latest... · 86ce03f4

Richard Huo authored Sep 17, 2025


fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>

86ce03f4

16 Sep, 2025 2 commits
- docs: add benchmark section to KVBM vLLM runbook (#3066) · 1ba53f2c
  Ziqi Fan authored Sep 16, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  1ba53f2c
- fix: Interactive inputs actually stops, does not ignore stop token (#3057) · 87e6e052
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87e6e052
10 Sep, 2025 2 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

docs: health check and structured logs (#2805) · 5d729c17
Neelay Shah authored Sep 10, 2025
```
Signed-off-by: nnshah1 <neelays@nvidia.com>
```
5d729c17

09 Sep, 2025 1 commit
- feat: automatically setup and inject prometheus configuration (#2912) · 729b5fd5
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  729b5fd5
05 Sep, 2025 1 commit
- docs: change docs to default port 8000 (#2876) · 1995ef9a
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1995ef9a
04 Sep, 2025 1 commit

fix: fix broken link in docs (#2870) · 432e8290

julienmancuso authored Sep 04, 2025


Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>

432e8290

03 Sep, 2025 2 commits

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

feat: workaround for bitnami brownout (#2843) · b97db875
julienmancuso authored Sep 03, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
b97db875

02 Sep, 2025 4 commits
- docs: add mention of deploy/utils quickstart to planner deployment docs (#2821) · a6e1d5fe
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a6e1d5fe
- feat: Cleanup dynamo cloud installation documentation (#2807) · ad4821c5
  julienmancuso authored Sep 02, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  ad4821c5
- feat: Add support for model express url injection (#2769) · 58d2699d
  julienmancuso authored Sep 02, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  58d2699d
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
30 Aug, 2025 2 commits
- feat: DIS-373 dynamo KVBM connector API integration with TRTLLM (#2544) · a68c2f8f
  Richard Huo authored Aug 29, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  a68c2f8f
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
29 Aug, 2025 1 commit
- feat: Add Grove and Kai scheduler as part of dynamo cloud helm chart (#2755) · e28ff8d2
  julienmancuso authored Aug 28, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  e28ff8d2
28 Aug, 2025 3 commits

docs: Use GFM Admonition style (#2771) · ea0c0027

Neal Vaidya authored Aug 28, 2025



Increases prominence of admonition in GitHub and still works correctly in sphinx thanks to ./docs/_extensions/github_alerts.py
Signed-off-by: Neal Vaidya <nealv@nvidia.com>

ea0c0027

feat: Auto-inject kai-scheduler annotations and label (#2748) · 9e6972a5
julienmancuso authored Aug 27, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
9e6972a5

feat: add reference setup for dynamo logging in k8s with loki (#2699) · 700d345d

mohammedabdulwahhab authored Aug 27, 2025


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

700d345d

26 Aug, 2025 1 commit

fix: fix metrics docs; add dcgm-exporter (#2712) · 6cf96e02

mohammedabdulwahhab authored Aug 26, 2025


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6cf96e02

25 Aug, 2025 1 commit
- docs: Simplify sphinx build and table of contents on webpage (#2519) · 766d3f2c
  Ryan McCormick authored Aug 25, 2025
  
  766d3f2c
22 Aug, 2025 1 commit
- feat: enable dynamo metrics on KVBM (#2626) · b658ba61
  Ziqi Fan authored Aug 22, 2025
  
  b658ba61