Commits · 7b2f95e49fbd884e43b07c73bf055c68cb7bfbaa · OpenDAS / dynamo · GitLab

22 Oct, 2025 5 commits
- fix: bug fixes for planner tests (#3821) · 7b2f95e4
  hhzhang16 authored Oct 22, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  7b2f95e4
- test: add backend-specific metrics validation for E2E tests (part 1/3, vLLM only) (#3804) · bdef0ec5
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bdef0ec5
- feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f93b619a
- fix: enhance gRPC frontend to return output in raw content field for Triton... · d68e4b8a
  GuanLuo authored Oct 22, 2025
```
fix: enhance gRPC frontend to return output in raw content field for Triton client compatibility (#3600)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  d68e4b8a
- fix: aiperf retry fix (#3678) · 03bd92de
  Tzu-Ling Kan authored Oct 21, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  03bd92de
21 Oct, 2025 4 commits
- feat: Detect if cluster has Grove. Use Grove if available. (#3789) · e6fc0e29
  Tzu-Ling Kan authored Oct 21, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  e6fc0e29
- feat: vllm moe k8 FT tests (#3672) · d81a00ef
  Tzu-Ling Kan authored Oct 21, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d81a00ef
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
- fix: Fix fault tolerance metrics calculation bug (#3674) · 9a723734
  Tzu-Ling Kan authored Oct 20, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  9a723734
20 Oct, 2025 1 commit
- fix: update aiperf commands for trace dataset (#3737) · abbbc187
  Hongkuan Zhou authored Oct 20, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  abbbc187
17 Oct, 2025 1 commit
- fix: standardize all planner ttft/itl units to float ms and fix docs (#3673) · ee56782b
  William Arnold authored Oct 17, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  ee56782b
16 Oct, 2025 6 commits
- fix: git lfs support is erratic with uv so set env var to force it (#3671) · 34fc9693
  Harrison Saturley-Hall authored Oct 16, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  34fc9693
- test: add durable consumer count test to CI using py-nats (#3669) · fdcc8d5b
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fdcc8d5b
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
- feat: Replace genai-perf with aiperf (#3533) · 9f310225
  Harshini Komali authored Oct 16, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  9f310225
- test: add tool calling and reasoning tests for frontend on GPT-OSS (#3636) · ea07d51f
  zhongdaor-nv authored Oct 15, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  ea07d51f
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 1 commit
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
14 Oct, 2025 2 commits
- fix: Add support for single element arrays for chat and completions prompts (#3482) · 3dc25129
  zhongdaor-nv authored Oct 14, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  3dc25129
- ci: Pass CLI Arguments to workers with a pytest fixture (#3605) · 4a55fa99
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  4a55fa99
12 Oct, 2025 1 commit
- chore: bump vllm to 0.11.0 (#3422) · 90dc7589
  Alec authored Oct 12, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  90dc7589
10 Oct, 2025 4 commits
- feat: Sglang Request cancellation (#3465) · 2d0dab74
  Indrajit Bhosale authored Oct 10, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  2d0dab74
- ci: TRTLLM & SGLang Unit Tests (for --custom-jinja-template) (#3472) · a3d46840
  KrishnanPrash authored Oct 10, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  a3d46840
- test: Update multimodal sglang response validation to be more consistent (#3552) · a90ada15
  Ryan McCormick authored Oct 10, 2025
  
  a90ada15
- feat: add Rust-to-Python const code generator for prometheus_names.py (#3425) · f2ba58e5
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f2ba58e5
09 Oct, 2025 2 commits
- chore: Remove clear_namespace script (#3519) · e9a71009
  Graham King authored Oct 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e9a71009
- feat: changing SIGKILL to SIGINT for graceful shutdown (#3513) · cdfd70f0
  Tzu-Ling Kan authored Oct 08, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  cdfd70f0
08 Oct, 2025 3 commits
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- fix: update dynamo namespace env var usage (#3477) · 552146f2
  Biswa Panda authored Oct 08, 2025
  
  552146f2
- feat: add Python MetricsRegistry Python metrics registration (#3341) · 0c4c4d1d
  Keiven C authored Oct 07, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0c4c4d1d
07 Oct, 2025 6 commits
- feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7
  Hongkuan Zhou authored Oct 07, 2025
```
feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  83e259a7
- ci: Removed pre-merge marker from test_vllm_unit.py (#3474) · 43ea602a
  KrishnanPrash authored Oct 07, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  43ea602a
- chore: add e2e test for reasoning_effort for gpt-oss model (#3421) · 89e7dab2
  zhongdaor-nv authored Oct 07, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  89e7dab2
- ci: Adding Unit Tests for vLLM (--custom-jinja-template) (#3362) · ff625465
  KrishnanPrash authored Oct 07, 2025
  
  ff625465
- chore: Clean up for sglang multimodal example (#3420) · ddbb4f50
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  ddbb4f50
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
06 Oct, 2025 4 commits

test: Remove timing dependency on E2E cancellation tests (#3391) · 4d48fe67
Jacky authored Oct 06, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
4d48fe67
feat: Add legacy client along with aiperf for FT tests (#3415) · f414bc5a
Indrajit Bhosale authored Oct 06, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
f414bc5a

test: Add per-worker routing and KV event synchronization test + minor... · 2160b913

Paul Li authored Oct 06, 2025

test: Add per-worker routing and KV event synchronization test + minor subscriber worker_id parsing fix (#3426)
Signed-off-by: Paul Li <zhixiong2008@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

2160b913

feat: time parsing logic (#3412) · 36116d7f
Tzu-Ling Kan authored Oct 06, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
36116d7f