Commits · 90caf3ea552718c71a29db2a78a005f8c6a642ec · OpenDAS / dynamo

24 Oct, 2025 2 commits

feat: Extend TensorRequest and TensorResponse to contains extra parameters (#3761) · 90caf3ea

KrishnanPrash authored Oct 24, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

90caf3ea

feat: TensorRT-LLM and SGLang metrics validation (part 2/3 + 3/3) (#3842) · 3e015595
Keiven C authored Oct 23, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
3e015595

23 Oct, 2025 2 commits
- test: fix KV Router and KVBM tests in CI (#3848) · 5f98e91e
  Richard Huo authored Oct 23, 2025
  
  5f98e91e
- feat: automatic profiling config generation (#3787) · a1b38af2
  Hongkuan Zhou authored Oct 23, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  a1b38af2
22 Oct, 2025 7 commits

fix: revert change to aiperf output format (#3837) · fa45ff1f
Hongkuan Zhou authored Oct 22, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
fa45ff1f

docs: address Harry/VDR feedback + fixing broken links across repository (#3802) · c6b59045

Anish authored Oct 22, 2025


Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

c6b59045

fix: bug fixes for planner tests (#3821) · 7b2f95e4
hhzhang16 authored Oct 22, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
7b2f95e4
test: add backend-specific metrics validation for E2E tests (part 1/3, vLLM only) (#3804) · bdef0ec5
Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
bdef0ec5
feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
f93b619a

fix: enhance gRPC frontend to return output in raw content field for Triton... · d68e4b8a

GuanLuo authored Oct 22, 2025

fix: enhance gRPC frontend to return output in raw content field for Triton client compatibility (#3600)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

d68e4b8a

fix: aiperf retry fix (#3678) · 03bd92de

Tzu-Ling Kan authored Oct 21, 2025


Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>

03bd92de

21 Oct, 2025 4 commits
- feat: Detect if cluster has Grove. Use Grove if available. (#3789) · e6fc0e29
  Tzu-Ling Kan authored Oct 21, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  e6fc0e29
- feat: vllm moe k8 FT tests (#3672) · d81a00ef
  Tzu-Ling Kan authored Oct 21, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d81a00ef
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
- fix: Fix fault tolerance metrics calculation bug (#3674) · 9a723734
  Tzu-Ling Kan authored Oct 20, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  9a723734
20 Oct, 2025 1 commit
- fix: update aiperf commands for trace dataset (#3737) · abbbc187
  Hongkuan Zhou authored Oct 20, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  abbbc187
17 Oct, 2025 1 commit
- fix: standardize all planner ttft/itl units to float ms and fix docs (#3673) · ee56782b
  William Arnold authored Oct 17, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  ee56782b
16 Oct, 2025 6 commits
- fix: git lfs support is erratic with uv so set env var to force it (#3671) · 34fc9693
  Harrison Saturley-Hall authored Oct 16, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  34fc9693
- test: add durable consumer count test to CI using py-nats (#3669) · fdcc8d5b
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fdcc8d5b
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
- feat: Replace genai-perf with aiperf (#3533) · 9f310225
  Harshini Komali authored Oct 16, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  9f310225
- test: add tool calling and reasoning tests for frontend on GPT-OSS (#3636) · ea07d51f
  zhongdaor-nv authored Oct 15, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  ea07d51f
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 1 commit
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
14 Oct, 2025 2 commits
- fix: Add support for single element arrays for chat and completions prompts (#3482) · 3dc25129
  zhongdaor-nv authored Oct 14, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  3dc25129
- ci: Pass CLI Arguments to workers with a pytest fixture (#3605) · 4a55fa99
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  4a55fa99
12 Oct, 2025 1 commit
- chore: bump vllm to 0.11.0 (#3422) · 90dc7589
  Alec authored Oct 12, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  90dc7589
10 Oct, 2025 4 commits
- feat: Sglang Request cancellation (#3465) · 2d0dab74
  Indrajit Bhosale authored Oct 10, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  2d0dab74
- ci: TRTLLM & SGLang Unit Tests (for --custom-jinja-template) (#3472) · a3d46840
  KrishnanPrash authored Oct 10, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  a3d46840
- test: Update multimodal sglang response validation to be more consistent (#3552) · a90ada15
  Ryan McCormick authored Oct 10, 2025
  
  a90ada15
- feat: add Rust-to-Python const code generator for prometheus_names.py (#3425) · f2ba58e5
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f2ba58e5
09 Oct, 2025 2 commits
- chore: Remove clear_namespace script (#3519) · e9a71009
  Graham King authored Oct 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e9a71009
- feat: changing SIGKILL to SIGINT for graceful shutdown (#3513) · cdfd70f0
  Tzu-Ling Kan authored Oct 08, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  cdfd70f0
08 Oct, 2025 3 commits
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- fix: update dynamo namespace env var usage (#3477) · 552146f2
  Biswa Panda authored Oct 08, 2025
  
  552146f2
- feat: add Python MetricsRegistry Python metrics registration (#3341) · 0c4c4d1d
  Keiven C authored Oct 07, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0c4c4d1d
07 Oct, 2025 4 commits
- feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7
  Hongkuan Zhou authored Oct 07, 2025
```
feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  83e259a7
- ci: Removed pre-merge marker from test_vllm_unit.py (#3474) · 43ea602a
  KrishnanPrash authored Oct 07, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  43ea602a
- chore: add e2e test for reasoning_effort for gpt-oss model (#3421) · 89e7dab2
  zhongdaor-nv authored Oct 07, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  89e7dab2
- ci: Adding Unit Tests for vLLM (--custom-jinja-template) (#3362) · ff625465
  KrishnanPrash authored Oct 07, 2025
  
  ff625465