Commits · f31a1dad65d84902217932149fa20c5dedc776c8 · OpenDAS / dynamo

03 Nov, 2025 1 commit

feat: grab num_experts info from model info if possible (#4060) · f31a1dad

hhzhang16 authored Nov 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

f31a1dad

31 Oct, 2025 2 commits
- fix: reduce max ISL when benchmarking prefill (#4030) · f2414f51
  Hongkuan Zhou authored Oct 31, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f2414f51
- refactor: move backend deploy, launch and slurm files from components to examples (#3849) · 8bd37c96
  Anant Sharma authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8bd37c96
30 Oct, 2025 1 commit
- feat: remove cluster wide logic from namespace restricted operator (#3934) · 6fc4c595
  hhzhang16 authored Oct 30, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  6fc4c595
29 Oct, 2025 1 commit
- fix: profiler sidecar and other SLA-driven autodeployment fixes (#3932) · a7b703bd
  hhzhang16 authored Oct 28, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a7b703bd
27 Oct, 2025 3 commits
- feat: turn profiling k8s jobs into sample DGDR requests (#3864) · 6a84ffd3
  hhzhang16 authored Oct 27, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  6a84ffd3
- refactor: remove hardcoded /workspace paths across tests (#3888) · 07cf0744
  Keiven C authored Oct 27, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  07cf0744
- fix: consistent model recipes and update simplified doc (#3858) · 0757ecf1
  Biswa Panda authored Oct 27, 2025
  
  0757ecf1
23 Oct, 2025 1 commit

feat: automatic profiling config generation (#3787) · a1b38af2

Hongkuan Zhou authored Oct 23, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

a1b38af2

21 Oct, 2025 1 commit
- feat: remove deploy/utils rbac (#3771) · eb73c2b0
  hhzhang16 authored Oct 21, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eb73c2b0
17 Oct, 2025 4 commits

feat: add DGDR custom resource (#3489) · 57cdb9a1

Julien Mancuso authored Oct 17, 2025

Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

57cdb9a1

fix: standardize all planner ttft/itl units to float ms and fix docs (#3673) · ee56782b
William Arnold authored Oct 17, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
ee56782b
fix: update k8s aic profile job arguments (#3699) · d3cdb91d
Hongkuan Zhou authored Oct 17, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
d3cdb91d
fix: json strings should remain intact through profiler arg processing (#3680) · 92064030
hhzhang16 authored Oct 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
92064030

16 Oct, 2025 2 commits
- fix: git lfs support is erratic with uv so set env var to force it (#3671) · 34fc9693
  Harrison Saturley-Hall authored Oct 16, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  34fc9693
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
15 Oct, 2025 1 commit
- feat: support yaml config input for pre-deployment sweep script (#3622) · 400dceae
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  400dceae
14 Oct, 2025 2 commits

chore: separate config modifier into multiple files (#3627) · f26d8da7
Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
f26d8da7

feat: update benchmarking script to use aiperf (#3306) · de3ca70b

Biswa Panda authored Oct 13, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: lkomali <lkomali@nvidia.com>
Co-authored-by: lkomali <lkomali@nvidia.com>
Co-authored-by: Harshini Komali <157742537+lkomali@users.noreply.github.com>

de3ca70b

09 Oct, 2025 2 commits
- fix: profilier bug fixes and doc improvements (#3530) · 179f993a
  Alec authored Oct 09, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  179f993a
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
07 Oct, 2025 1 commit

feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7

Hongkuan Zhou authored Oct 07, 2025


feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

83e259a7

02 Oct, 2025 1 commit
- fix: correctly parse subcomponent in sla-planner + deploy/doc update (#3363) · cfe74445
  Hongkuan Zhou authored Oct 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cfe74445
29 Sep, 2025 1 commit

feat: add subComponentType in DGD API and uptake in planner (#3200) · 1a5016b0

Thomas Montfort authored Sep 29, 2025


Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>

1a5016b0

24 Sep, 2025 1 commit

feat: support MoE model in SLA Planner Sglang (#3185) · 6243bcbe

Hongkuan Zhou authored Sep 23, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

6243bcbe

19 Sep, 2025 2 commits

fix: small planner manifest/doc fixes (#3129) · 7d2fc13e
Thomas Montfort authored Sep 19, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
7d2fc13e

feat: Add --use-ai-configurator to profile_sla.py (#3079) · 19948b7f

Ilya Sherstyuk authored Sep 19, 2025


Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

19948b7f

16 Sep, 2025 1 commit
- fix: move deep_update function to trtllm folder (#3070) · 2bb1b268
  Hongkuan Zhou authored Sep 16, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2bb1b268
10 Sep, 2025 1 commit

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

09 Sep, 2025 2 commits
- feat: add init file to profiler folder (#2962) · eaa03383
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eaa03383
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
04 Sep, 2025 1 commit
- test: add test for pre-deployment script (#2857) · f72dc01d
  Hongkuan Zhou authored Sep 04, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f72dc01d
02 Sep, 2025 2 commits

docs: update profiling-related docs (#2816) · 7eef9ac3

hhzhang16 authored Sep 02, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

7eef9ac3

chore: add pydantic validation for benchmark profile config (#2791) · 882ae1b4
Michael Shin authored Sep 02, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
882ae1b4

30 Aug, 2025 1 commit
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
22 Aug, 2025 1 commit
- fix: missing tokenizer args in sla_planner.py (#2667) · 268d017e
  Hongkuan Zhou authored Aug 22, 2025
  
  268d017e
21 Aug, 2025 1 commit
- fix: profiling script missing tests when kv cache is tight (#2567) · b98188c8
  Hongkuan Zhou authored Aug 21, 2025
  
  b98188c8
20 Aug, 2025 1 commit
- feat: add --tokenizer_path to profile_endpoint.py (#2550) · 59053354
  Jason Zhou authored Aug 20, 2025
  
  59053354
15 Aug, 2025 1 commit
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
12 Aug, 2025 1 commit

feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68

Hongkuan Zhou authored Aug 12, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

b4189c68