Commits · 3e015595ccb8c85e35dba6b836be8f721b71da6f · OpenDAS / dynamo

24 Oct, 2025 1 commit
- feat: TensorRT-LLM and SGLang metrics validation (part 2/3 + 3/3) (#3842) · 3e015595
  Keiven C authored Oct 23, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3e015595
23 Oct, 2025 4 commits
- chore: restructure mocker cli args handling, to include prefill/decode (#3847) · 41ff394f
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  41ff394f
- refactor: kvbm modularity DIS-657 Eliminate ETCD from the leader-worker initialization (#3202) · 94aa2a7b
  Richard Huo authored Oct 23, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  94aa2a7b
- fix: update planner path after components restructure (#3614) · f6cb6cfd
  Hongkuan Zhou authored Oct 22, 2025
```
Signed-off-by: hongkuan <hongkuanz@nvidia.com>
```
  f6cb6cfd
- perf: cache compiled regex patterns in prometheus metrics filtering (#3825) · 7bb6368f
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  7bb6368f
22 Oct, 2025 5 commits

docs: address Harry/VDR feedback + fixing broken links across repository (#3802) · c6b59045

Anish authored Oct 22, 2025


Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

c6b59045

fix: bug fixes for planner tests (#3821) · 7b2f95e4
hhzhang16 authored Oct 22, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
7b2f95e4
chore: no need to publish kv events for decode vllm worker (#3819) · fb294b90
Yan Ru Pei authored Oct 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
fb294b90
feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
f93b619a
fix: disagg dp attention needs host 0.0.0.0 (#3809) · 79ad7f36
ishandhanani authored Oct 22, 2025

79ad7f36

21 Oct, 2025 1 commit
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
17 Oct, 2025 1 commit
- fix: standardize all planner ttft/itl units to float ms and fix docs (#3673) · ee56782b
  William Arnold authored Oct 17, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  ee56782b
16 Oct, 2025 4 commits
- docs: reorganizing documentation to make things clearer (#3658) · 598cbbb7
  Anish authored Oct 16, 2025
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
```
  598cbbb7
- docs: move SGLang and vLLM Prometheus metrics documentation to docs path (#3677) · f4cd71f3
  Keiven C authored Oct 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f4cd71f3
- fix: add `--host` to k8s and bump sgl version (#3666) · 9a002b30
  ishandhanani authored Oct 15, 2025
  
  9a002b30
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 3 commits
- fix: Reduce memory usage to avoid vLLM dsr1 OOM (#3660) · 29f5b822
  Kris Hung authored Oct 15, 2025
  
  29f5b822
- feat: Replace genai-perf with aiperf in components/backends (#3528) · a7badb85
  Harshini Komali authored Oct 15, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  a7badb85
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
14 Oct, 2025 5 commits
- chore: update sglang to 0.5.3.post1 to take advantage of container + doc cleanup (#3621) · c6e3db5e
  ishandhanani authored Oct 14, 2025
  
  c6e3db5e
- chore: typo and new commands (#3617) · 4c4130e3
  ishandhanani authored Oct 14, 2025
  
  4c4130e3
- fix: Add support for single element arrays for chat and completions prompts (#3482) · 3dc25129
  zhongdaor-nv authored Oct 14, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  3dc25129
- feat: catch Trtllm engine exceptions (#3544) · 1ad2a3b8
  Tzu-Ling Kan authored Oct 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1ad2a3b8
- fix: only log config on `debug` log level, fix trtllm warnings (#3590) · 7b0fad3f
  William Arnold authored Oct 14, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  7b0fad3f
11 Oct, 2025 2 commits
- feat: implement custom backend metrics for NIM (#3266) · 65cc5337
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  65cc5337
- feat: add SGLang and vLLM passthrough metrics on Dynamo backend worker (#3539) · 55e458d8
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  55e458d8
10 Oct, 2025 5 commits
- feat: Sglang Request cancellation (#3465) · 2d0dab74
  Indrajit Bhosale authored Oct 10, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  2d0dab74
- ci: TRTLLM & SGLang Unit Tests (for --custom-jinja-template) (#3472) · a3d46840
  KrishnanPrash authored Oct 10, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  a3d46840
- feat: add Rust-to-Python const code generator for prometheus_names.py (#3425) · f2ba58e5
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f2ba58e5
- docs: move all md files from components to docs (#3440) · 0a2a820b
  Anant Sharma authored Oct 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  0a2a820b
- fix: Send last token batch when finish_reason is set (#3531) · 111c6814
  Ryan McCormick authored Oct 09, 2025
  
  111c6814
09 Oct, 2025 8 commits
- refactor: remove sglang config and util files from components (#3467) · 03bdced9
  Anant Sharma authored Oct 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  03bdced9
- feat: sglang prefill router + bump to `0.5.3` (#3498) · 51f65757
  ishandhanani authored Oct 09, 2025
  
  51f65757
- refactor: remove vllm prefill worker background loop check (#3529) · 07a64744
  Yan Ru Pei authored Oct 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  07a64744
- docs: add vLLM KVBM 2P2D example due to a special ENV VAR to note (#3526) · 44012a24
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  44012a24
- chore: add sample KVBM related k8s deployment manifests (#3523) · 5f7c1f7e
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  5f7c1f7e
- chore: Remove clear_namespace script (#3519) · e9a71009
  Graham King authored Oct 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e9a71009
- chore: Remove deprecated components/metrics and references (#3475) · be001a58
  Keiven C authored Oct 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  be001a58
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
08 Oct, 2025 1 commit
- fix: remove _version import in config_dump (#3502) · 9b5bab72
  William Arnold authored Oct 08, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  9b5bab72