Commits · d3cdb91d706b8d01d8f80be2ca77271d1e9bc905 · OpenDAS / dynamo

17 Oct, 2025 2 commits
- fix: update k8s aic profile job arguments (#3699) · d3cdb91d
  Hongkuan Zhou authored Oct 17, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  d3cdb91d
- fix: json strings should remain intact through profiler arg processing (#3680) · 92064030
  hhzhang16 authored Oct 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  92064030
16 Oct, 2025 4 commits
- fix: git lfs support is erratic with uv so set env var to force it (#3671) · 34fc9693
  Harrison Saturley-Hall authored Oct 16, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  34fc9693
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
- feat: Replace genai-perf with aiperf (#3533) · 9f310225
  Harshini Komali authored Oct 16, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  9f310225
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 1 commit
- feat: support yaml config input for pre-deployment sweep script (#3622) · 400dceae
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  400dceae
14 Oct, 2025 3 commits
- chore: separate config modifier into multiple files (#3627) · f26d8da7
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f26d8da7
- feat: add pre-deployment check for storageclass (#3573) · 9bb2bc93
  Biswa Panda authored Oct 13, 2025
  
  9bb2bc93
- feat: update benchmarking script to use aiperf (#3306) · de3ca70b
  Biswa Panda authored Oct 13, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: lkomali <lkomali@nvidia.com>
Co-authored-by: lkomali <lkomali@nvidia.com>
Co-authored-by: Harshini Komali <157742537+lkomali@users.noreply.github.com>
```
  de3ca70b
09 Oct, 2025 3 commits

fix: profilier bug fixes and doc improvements (#3530) · 179f993a

Alec authored Oct 09, 2025


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>

179f993a

fix: use rolling hasher for sin_synth.py (#3514) · f712653e

Hongkuan Zhou authored Oct 08, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

f712653e

fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
bd28e442

08 Oct, 2025 3 commits
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
- fix: minor robustness improvement for datagen analyze (#3483) · ec438f8c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ec438f8c
- feat: a script to convert BurstGPT to mooncake format (#3479) · 87825339
  Hongkuan Zhou authored Oct 07, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  87825339
07 Oct, 2025 1 commit

feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7

Hongkuan Zhou authored Oct 07, 2025


feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

83e259a7

03 Oct, 2025 1 commit
- fix: remove CVE introduced by aiconfigurator to runtime containers (#3367) · e1ed7009
  Harrison Saturley-Hall authored Oct 03, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  e1ed7009
02 Oct, 2025 1 commit
- fix: correctly parse subcomponent in sla-planner + deploy/doc update (#3363) · cfe74445
  Hongkuan Zhou authored Oct 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cfe74445
01 Oct, 2025 1 commit
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
29 Sep, 2025 2 commits
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
- feat: add subComponentType in DGD API and uptake in planner (#3200) · 1a5016b0
  Thomas Montfort authored Sep 29, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  1a5016b0
26 Sep, 2025 1 commit
- docs: mention need for H100 for gpt-oss-120b in router benchmarking docs (#3242) · 45a4b7cf
  Yan Ru Pei authored Sep 26, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  45a4b7cf
25 Sep, 2025 1 commit
- docs: some router-related doc fixes for 0.5.1 release (#3232) · a69efbd1
  Yan Ru Pei authored Sep 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a69efbd1
24 Sep, 2025 4 commits
- feat: update how inputs are input into the benchmark script (#3187) · fb12b67f
  hhzhang16 authored Sep 24, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  fb12b67f
- fix: update the tags for consistency and remove 0.4.1 refs (#3058) · 9e8f67ed
  Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9e8f67ed
- feat: allow users to only plot certain subdirs (#3190) · 4800d0be
  hhzhang16 authored Sep 24, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  4800d0be
- feat: support MoE model in SLA Planner Sglang (#3185) · 6243bcbe
  Hongkuan Zhou authored Sep 23, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  6243bcbe
23 Sep, 2025 1 commit

feat: allow in-cluster perf benchmarks with a kubectl one-liner (#3144) · ce36d9f4

hhzhang16 authored Sep 23, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Thomas Montfort <61255722+tmonty12@users.noreply.github.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Richard Huo <rihuo@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tzu-Ling Kan <tzulingk@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>

ce36d9f4

22 Sep, 2025 1 commit
- feat: vllm prefill router (#3155) · 031590fc
  Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  031590fc
19 Sep, 2025 2 commits

fix: small planner manifest/doc fixes (#3129) · 7d2fc13e
Thomas Montfort authored Sep 19, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
7d2fc13e

feat: Add --use-ai-configurator to profile_sla.py (#3079) · 19948b7f

Ilya Sherstyuk authored Sep 19, 2025


Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

19948b7f

18 Sep, 2025 2 commits

feat: remove kubectl dependencies from benchmarking (#3098) · 20b7a8ae

hhzhang16 authored Sep 18, 2025

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

20b7a8ae

feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2

Chi McIsaac authored Sep 18, 2025

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

3b6dbef2

17 Sep, 2025 1 commit

feat: decouple existing benchmarking within docs (#3072) · 26889b09

hhzhang16 authored Sep 17, 2025

26889b09

16 Sep, 2025 3 commits
- fix: move deep_update function to trtllm folder (#3070) · 2bb1b268
  Hongkuan Zhou authored Sep 16, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2bb1b268
- chore: a few small benchmarking and profiling improvements (#3069) · f77511ff
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  f77511ff
- feat: add mooncake-style benchmarking for router (#3068) · 38300f22
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38300f22
15 Sep, 2025 1 commit
- feat: decouple dynamo k8s setup from additional benchmarking requirements (#2973) · c82f477d
  hhzhang16 authored Sep 15, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  c82f477d
10 Sep, 2025 1 commit

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd