Commits · de5ab2c4af7db69039115dc0c9efae5a3383dcc8 · OpenDAS / dynamo

"lib/llm/vscode:/vscode.git/clone" did not exist on "4000097653a9d6d345be96ff1466532a3a30f6f5"

10 Sep, 2025 1 commit
- docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
  Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  de5ab2c4
09 Sep, 2025 5 commits
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
- docs: update how deploy util helper files are mentioned (#2957) · 241bd014
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  241bd014
- feat: add a virtual connector for 3rd party deployments (#2913) · 8543d0d3
  Hongkuan Zhou authored Sep 09, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  8543d0d3
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
- feat: automatically setup and inject prometheus configuration (#2912) · 729b5fd5
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  729b5fd5
05 Sep, 2025 1 commit
- docs: change docs to default port 8000 (#2876) · 1995ef9a
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1995ef9a
04 Sep, 2025 1 commit

fix: fix broken link in docs (#2870) · 432e8290

julienmancuso authored Sep 04, 2025


Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>

432e8290

03 Sep, 2025 3 commits

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

feat: workaround for bitnami brownout (#2843) · b97db875
julienmancuso authored Sep 03, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
b97db875
feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
383e3b3a

02 Sep, 2025 6 commits
- docs: add mention of deploy/utils quickstart to planner deployment docs (#2821) · a6e1d5fe
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a6e1d5fe
- docs: update profiling-related docs (#2816) · 7eef9ac3
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  7eef9ac3
- feat: Cleanup dynamo cloud installation documentation (#2807) · ad4821c5
  julienmancuso authored Sep 02, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  ad4821c5
- chore: bump version numbers ahead of 0.5.0 release (#2812) · 561ecb98
  Harrison Saturley-Hall authored Sep 02, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  561ecb98
- feat: Add support for model express url injection (#2769) · 58d2699d
  julienmancuso authored Sep 02, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  58d2699d
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 4 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- fix: fix #2653: links of h100_prefill_performance.png and h100_decode_performance.png (#2650) · 3f09c395
  Jason Zhou authored Aug 30, 2025
  
  3f09c395
- feat: DIS-373 dynamo KVBM connector API integration with TRTLLM (#2544) · a68c2f8f
  Richard Huo authored Aug 29, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  a68c2f8f
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
29 Aug, 2025 3 commits
- test: add tests for replica calculation and planner scaling (#2525) · 353ba5db
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  353ba5db
- feat: Add Encode Worker and NIXL support to trtllm multimodal flow (#2452) · 781fa062
  Indrajit Bhosale authored Aug 29, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  781fa062
- feat: Add Grove and Kai scheduler as part of dynamo cloud helm chart (#2755) · e28ff8d2
  julienmancuso authored Aug 28, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  e28ff8d2
28 Aug, 2025 4 commits

docs: Use GFM Admonition style (#2771) · ea0c0027

Neal Vaidya authored Aug 28, 2025



Increases prominence of admonition in GitHub and still works correctly in sphinx thanks to ./docs/_extensions/github_alerts.py
Signed-off-by: Neal Vaidya <nealv@nvidia.com>

ea0c0027

chore: Update support_matrix.md (#2735) · 46175f5d
Dmitry Tokarev authored Aug 27, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
46175f5d
feat: Auto-inject kai-scheduler annotations and label (#2748) · 9e6972a5
julienmancuso authored Aug 27, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
9e6972a5

feat: add reference setup for dynamo logging in k8s with loki (#2699) · 700d345d

mohammedabdulwahhab authored Aug 27, 2025


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

700d345d

26 Aug, 2025 1 commit

fix: fix metrics docs; add dcgm-exporter (#2712) · 6cf96e02

mohammedabdulwahhab authored Aug 26, 2025


Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6cf96e02

25 Aug, 2025 2 commits
- docs: Simplify sphinx build and table of contents on webpage (#2519) · 766d3f2c
  Ryan McCormick authored Aug 25, 2025
  
  766d3f2c
- feat: python bindings for the entire KvPushRouter + per-request router configs (#2658) · f08729ae
  Yan Ru Pei authored Aug 25, 2025
  
  f08729ae
22 Aug, 2025 3 commits
- feat: enable dynamo metrics on KVBM (#2626) · b658ba61
  Ziqi Fan authored Aug 22, 2025
  
  b658ba61
- docs: update trtllm know issue message (#2639) · ea391f38
  Anant Sharma authored Aug 22, 2025
  
  ea391f38
- fix: Update tensorrt_llm to 1.0.0rc6 (#2606) · 9ab37d94
  Tanmay Verma authored Aug 21, 2025
  
  9ab37d94
21 Aug, 2025 3 commits
- docs: fix doc for kvbm (#2621) · 15cccfe4
  ZichengMa authored Aug 21, 2025
  
  15cccfe4
- docs: add trtllm known issue for al2023 (#2604) · cc48dd3e
  Anant Sharma authored Aug 21, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  cc48dd3e
- chore: remove circus dependency (#2602) · 28fb77cf
  Hongkuan Zhou authored Aug 21, 2025
  
  28fb77cf
20 Aug, 2025 2 commits
- test: add dryrun mode for sla planner (#2557) · 1b3a1073
  Hongkuan Zhou authored Aug 20, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  1b3a1073
- chore: Bumped Dynamo version to 0.4.1 (#2545) · 9a021885
  Dmitry Tokarev authored Aug 19, 2025
  
  9a021885