Commits · 83e259a7ccf16d10c0bc175136f9092ed7c87ae3 · OpenDAS / dynamo

07 Oct, 2025 1 commit

feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7

Hongkuan Zhou authored Oct 07, 2025


feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

83e259a7

03 Oct, 2025 1 commit

docs: add Planner Quickstart doc (#3358) · 89cf9107

hhzhang16 authored Oct 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

89cf9107

02 Oct, 2025 1 commit
- fix: correctly parse subcomponent in sla-planner + deploy/doc update (#3363) · cfe74445
  Hongkuan Zhou authored Oct 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cfe74445
26 Sep, 2025 1 commit
- docs: Fix profile_sla command in docs (#3258) · 9d73be12
  Ilya Sherstyuk authored Sep 26, 2025
```
Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
```
  9d73be12
24 Sep, 2025 2 commits

fix: update the tags for consistency and remove 0.4.1 refs (#3058) · 9e8f67ed

Harrison Saturley-Hall authored Sep 24, 2025


Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

9e8f67ed

feat: support MoE model in SLA Planner Sglang (#3185) · 6243bcbe

Hongkuan Zhou authored Sep 23, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

6243bcbe

23 Sep, 2025 1 commit

feat: revamp kubernetes doc (#3173) · 4a718028

Julien Mancuso authored Sep 23, 2025


Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

4a718028

19 Sep, 2025 2 commits

fix: small planner manifest/doc fixes (#3129) · 7d2fc13e
Thomas Montfort authored Sep 19, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
7d2fc13e

feat: Add --use-ai-configurator to profile_sla.py (#3079) · 19948b7f

Ilya Sherstyuk authored Sep 19, 2025


Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

19948b7f

16 Sep, 2025 1 commit
- chore: a few small benchmarking and profiling improvements (#3069) · f77511ff
  hhzhang16 authored Sep 16, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  f77511ff
15 Sep, 2025 1 commit
- feat: decouple dynamo k8s setup from additional benchmarking requirements (#2973) · c82f477d
  hhzhang16 authored Sep 15, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  c82f477d
10 Sep, 2025 1 commit

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

09 Sep, 2025 2 commits

docs: update how deploy util helper files are mentioned (#2957) · 241bd014

hhzhang16 authored Sep 09, 2025

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

241bd014

feat: update benchmarking and deploy utils (#2933) · 09c7b73c
hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
09c7b73c

02 Sep, 2025 1 commit

docs: update profiling-related docs (#2816) · 7eef9ac3

hhzhang16 authored Sep 02, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

7eef9ac3

30 Aug, 2025 2 commits
- fix: fix #2653: links of h100_prefill_performance.png and h100_decode_performance.png (#2650) · 3f09c395
  Jason Zhou authored Aug 30, 2025
  
  3f09c395
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
25 Aug, 2025 1 commit
- docs: Simplify sphinx build and table of contents on webpage (#2519) · 766d3f2c
  Ryan McCormick authored Aug 25, 2025
  
  766d3f2c
15 Aug, 2025 1 commit
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
12 Aug, 2025 1 commit

feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68

Hongkuan Zhou authored Aug 12, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

b4189c68

11 Aug, 2025 1 commit
- feat: profiling PVC updates for better UX (#2402) · bea92eae
  hhzhang16 authored Aug 11, 2025
  
  bea92eae
29 Jul, 2025 1 commit
- chore: add instructions to modify SLA to profile_sla doc; update component name (#2167) · 157714aa
  Hongkuan Zhou authored Jul 29, 2025
  
  157714aa
28 Jul, 2025 1 commit

feat: Deploy SLA planner to Kubernetes (#2135) · d23d48ba

hhzhang16 authored Jul 28, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

d23d48ba

24 Jul, 2025 1 commit

feat: deploy SLA profiler to k8s (#2030) · fe718fd2

hhzhang16 authored Jul 24, 2025


Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fe718fd2