Commits · 2b5655fd43fa45f002a532d0d8239c4b4d99ac71 · OpenDAS / dynamo

02 Dec, 2025 1 commit
- feat: mocker <> planner profiler (#4651) · 2b5655fd
  Hongkuan Zhou authored Dec 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2b5655fd
26 Nov, 2025 1 commit
- feat: support MQA + MoE (Qwen3 MoE) TEP/DEP in Planner Profiler (#4612) · 5652d670
  Hongkuan Zhou authored Nov 25, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  5652d670
17 Nov, 2025 1 commit
- fix: DSR1 DEP Prefill Profiling Benchmark (#4367) · cf97c0dc
  Hongkuan Zhou authored Nov 17, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cf97c0dc
10 Nov, 2025 2 commits

feat: DynamoPlanner profiler to use hf_id for AIConfigurator 0.4.0 (#4167) · 43986372

Jason Zhou authored Nov 10, 2025


Signed-off-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
Co-authored-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>

43986372

feat: support TEP/DEP for DSR1 in SGLang MoE Planner (#4203) · 5e4a339a

Hongkuan Zhou authored Nov 10, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

5e4a339a

07 Nov, 2025 1 commit

feat: add parallelization filters (#4144) · 7750ed1a

Hongkuan Zhou authored Nov 07, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

7750ed1a

05 Nov, 2025 1 commit
- feat: add cost plot to profiler (#4003) · 0b284b63
  Hongkuan Zhou authored Nov 05, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0b284b63
04 Nov, 2025 1 commit

feat: use configmap instead of PVC for profiling results (#3981) · d3706221

Hongkuan Zhou authored Nov 04, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>

d3706221

03 Nov, 2025 1 commit

feat: grab num_experts info from model info if possible (#4060) · f31a1dad

hhzhang16 authored Nov 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

f31a1dad

27 Oct, 2025 1 commit

feat: turn profiling k8s jobs into sample DGDR requests (#3864) · 6a84ffd3

hhzhang16 authored Oct 27, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

6a84ffd3

17 Oct, 2025 1 commit

feat: add DGDR custom resource (#3489) · 57cdb9a1

Julien Mancuso authored Oct 17, 2025

Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

57cdb9a1

16 Oct, 2025 1 commit
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
15 Oct, 2025 1 commit
- feat: support yaml config input for pre-deployment sweep script (#3622) · 400dceae
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  400dceae
14 Oct, 2025 2 commits

chore: separate config modifier into multiple files (#3627) · f26d8da7
Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
f26d8da7

feat: update benchmarking script to use aiperf (#3306) · de3ca70b

Biswa Panda authored Oct 13, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: lkomali <lkomali@nvidia.com>
Co-authored-by: lkomali <lkomali@nvidia.com>
Co-authored-by: Harshini Komali <157742537+lkomali@users.noreply.github.com>

de3ca70b

09 Oct, 2025 1 commit
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
07 Oct, 2025 1 commit

feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7

Hongkuan Zhou authored Oct 07, 2025


feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

83e259a7

24 Sep, 2025 1 commit

feat: support MoE model in SLA Planner Sglang (#3185) · 6243bcbe

Hongkuan Zhou authored Sep 23, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

6243bcbe

19 Sep, 2025 1 commit

feat: Add --use-ai-configurator to profile_sla.py (#3079) · 19948b7f

Ilya Sherstyuk authored Sep 19, 2025


Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

19948b7f

10 Sep, 2025 1 commit

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

04 Sep, 2025 1 commit
- test: add test for pre-deployment script (#2857) · f72dc01d
  Hongkuan Zhou authored Sep 04, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f72dc01d
30 Aug, 2025 1 commit
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
22 Aug, 2025 1 commit
- fix: missing tokenizer args in sla_planner.py (#2667) · 268d017e
  Hongkuan Zhou authored Aug 22, 2025
  
  268d017e
20 Aug, 2025 1 commit
- feat: add --tokenizer_path to profile_endpoint.py (#2550) · 59053354
  Jason Zhou authored Aug 20, 2025
  
  59053354
15 Aug, 2025 1 commit
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
12 Aug, 2025 1 commit

feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68

Hongkuan Zhou authored Aug 12, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

b4189c68

11 Aug, 2025 1 commit
- feat: standalone profiling script for a given endpoint (#2386) · fd358991
  Hongkuan Zhou authored Aug 11, 2025
  
  fd358991
28 Jul, 2025 1 commit

feat: Deploy SLA planner to Kubernetes (#2135) · d23d48ba

hhzhang16 authored Jul 28, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

d23d48ba

24 Jul, 2025 1 commit

feat: deploy SLA profiler to k8s (#2030) · fe718fd2

hhzhang16 authored Jul 24, 2025


Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fe718fd2

18 Jun, 2025 1 commit

refactor: break profile_sla into different files; feat: support vllm_v1 (#1588) · 7ff10067

Hongkuan Zhou authored Jun 18, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

7ff10067

14 Jun, 2025 1 commit

feat: SLA-based Planner (#1420) · 3f53a78e

Hongkuan Zhou authored Jun 13, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

3f53a78e

03 Jun, 2025 1 commit
- fix: update profile script (#1336) · f8213242
  Hongkuan Zhou authored Jun 03, 2025
  
  f8213242
22 May, 2025 2 commits
- feat: Add TTFT and ITL Interpolation to Profiling Script (#1159) · 7860861f
  Hongkuan Zhou authored May 22, 2025
```
Co-authored-by: root <root@kkranen-dt.nvidia.com>
```
  7860861f
- fix: typo in planner doc and log (#1165) · 3d697d4d
  Hongkuan Zhou authored May 22, 2025
  
  3d697d4d
20 May, 2025 1 commit
- feat: SLA Profiling and Recommending Parallelization Mapping (#1114) · 93702e44
  Hongkuan Zhou authored May 20, 2025
  
  93702e44