Commits · 120ae64916200f95cf8dbdbabf224fb212b4277d · OpenDAS / dynamo

09 Feb, 2026 1 commit

fix: profiler deployment timeout handling for MoE models (#6086) · 67329d10

MatejKosec authored Feb 09, 2026

Wrap wait_for_deployment_ready() in try/except TimeoutError for both prefill and decode profiling sweeps
On timeout: log error, record via add_profiling_error(), clean up the timed-out deployment, and continue to the next parallelization mapping
Previously, a single deployment timeout would crash the entire profiler job

67329d10

04 Feb, 2026 1 commit
- fix: Add status file to prevent output-copier hang on failures (#5898) · 0268aea4
  hhzhang16 authored Feb 03, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  0268aea4
03 Feb, 2026 1 commit
- fix: check --served-model-name first before --model/--model-path (#5881) · 2b199540
  hhzhang16 authored Feb 02, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  2b199540
14 Jan, 2026 1 commit

feat: SLA Planner configuration support for DEP and TEP VLLM (#4783) · 7cfd966e

MatejKosec authored Jan 14, 2026

Extends the MOE planner profiler to support  TEP (tensor expert parallel) and DEP (data expert parallel) configs with the vllm backend

7cfd966e

02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit
- refactor: preview config in profiler webui use planner dgd generation logic (#4940) · e49834c9
  Hongkuan Zhou authored Dec 31, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  e49834c9
16 Dec, 2025 1 commit

feat: Profiler WebUI improvements -- error handling, GPU hours, style fixes,... · 6b5842ee

hhzhang16 authored Dec 16, 2025


feat: Profiler WebUI improvements -- error handling, GPU hours, style fixes, preview configs (#4968)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>

6b5842ee

10 Dec, 2025 1 commit

feat: add webUI to profiler (#4544) · ca0cd3b1

Hongkuan Zhou authored Dec 10, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

ca0cd3b1

02 Dec, 2025 1 commit
- feat: mocker <> planner profiler (#4651) · 2b5655fd
  Hongkuan Zhou authored Dec 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2b5655fd
26 Nov, 2025 1 commit
- feat: support MQA + MoE (Qwen3 MoE) TEP/DEP in Planner Profiler (#4612) · 5652d670
  Hongkuan Zhou authored Nov 25, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  5652d670
17 Nov, 2025 1 commit
- fix: DSR1 DEP Prefill Profiling Benchmark (#4367) · cf97c0dc
  Hongkuan Zhou authored Nov 17, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cf97c0dc
10 Nov, 2025 2 commits

feat: DynamoPlanner profiler to use hf_id for AIConfigurator 0.4.0 (#4167) · 43986372

Jason Zhou authored Nov 10, 2025


Signed-off-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
Co-authored-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>

43986372

feat: support TEP/DEP for DSR1 in SGLang MoE Planner (#4203) · 5e4a339a

Hongkuan Zhou authored Nov 10, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

5e4a339a

07 Nov, 2025 1 commit

feat: add parallelization filters (#4144) · 7750ed1a

Hongkuan Zhou authored Nov 07, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

7750ed1a

05 Nov, 2025 1 commit
- feat: add cost plot to profiler (#4003) · 0b284b63
  Hongkuan Zhou authored Nov 05, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0b284b63
04 Nov, 2025 1 commit

feat: use configmap instead of PVC for profiling results (#3981) · d3706221

Hongkuan Zhou authored Nov 04, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>

d3706221

03 Nov, 2025 1 commit

feat: grab num_experts info from model info if possible (#4060) · f31a1dad

hhzhang16 authored Nov 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

f31a1dad

27 Oct, 2025 1 commit

feat: turn profiling k8s jobs into sample DGDR requests (#3864) · 6a84ffd3

hhzhang16 authored Oct 27, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

6a84ffd3

17 Oct, 2025 1 commit

feat: add DGDR custom resource (#3489) · 57cdb9a1

Julien Mancuso authored Oct 17, 2025

Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

57cdb9a1

16 Oct, 2025 1 commit
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
15 Oct, 2025 1 commit
- feat: support yaml config input for pre-deployment sweep script (#3622) · 400dceae
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  400dceae
14 Oct, 2025 2 commits

chore: separate config modifier into multiple files (#3627) · f26d8da7
Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
f26d8da7

feat: update benchmarking script to use aiperf (#3306) · de3ca70b

Biswa Panda authored Oct 13, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: lkomali <lkomali@nvidia.com>
Co-authored-by: lkomali <lkomali@nvidia.com>
Co-authored-by: Harshini Komali <157742537+lkomali@users.noreply.github.com>

de3ca70b

09 Oct, 2025 1 commit
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
07 Oct, 2025 1 commit

feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7

Hongkuan Zhou authored Oct 07, 2025


feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

83e259a7

24 Sep, 2025 1 commit

feat: support MoE model in SLA Planner Sglang (#3185) · 6243bcbe

Hongkuan Zhou authored Sep 23, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

6243bcbe

19 Sep, 2025 1 commit

feat: Add --use-ai-configurator to profile_sla.py (#3079) · 19948b7f

Ilya Sherstyuk authored Sep 19, 2025


Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

19948b7f

10 Sep, 2025 1 commit

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

04 Sep, 2025 1 commit
- test: add test for pre-deployment script (#2857) · f72dc01d
  Hongkuan Zhou authored Sep 04, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f72dc01d
30 Aug, 2025 1 commit
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
22 Aug, 2025 1 commit
- fix: missing tokenizer args in sla_planner.py (#2667) · 268d017e
  Hongkuan Zhou authored Aug 22, 2025
  
  268d017e
20 Aug, 2025 1 commit
- feat: add --tokenizer_path to profile_endpoint.py (#2550) · 59053354
  Jason Zhou authored Aug 20, 2025
  
  59053354
15 Aug, 2025 1 commit
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
12 Aug, 2025 1 commit

feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68

Hongkuan Zhou authored Aug 12, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

b4189c68

11 Aug, 2025 1 commit
- feat: standalone profiling script for a given endpoint (#2386) · fd358991
  Hongkuan Zhou authored Aug 11, 2025
  
  fd358991
28 Jul, 2025 1 commit

feat: Deploy SLA planner to Kubernetes (#2135) · d23d48ba

hhzhang16 authored Jul 28, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

d23d48ba

24 Jul, 2025 1 commit

feat: deploy SLA profiler to k8s (#2030) · fe718fd2

hhzhang16 authored Jul 24, 2025


Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fe718fd2

18 Jun, 2025 1 commit

refactor: break profile_sla into different files; feat: support vllm_v1 (#1588) · 7ff10067

Hongkuan Zhou authored Jun 18, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

7ff10067

14 Jun, 2025 1 commit

feat: SLA-based Planner (#1420) · 3f53a78e

Hongkuan Zhou authored Jun 13, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

3f53a78e

03 Jun, 2025 1 commit
- fix: update profile script (#1336) · f8213242
  Hongkuan Zhou authored Jun 03, 2025
  
  f8213242