Commits · dcee4dbd17693b0db7918c92dcee9a5af9753f41 · OpenDAS / dynamo

10 Sep, 2025 1 commit

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

09 Sep, 2025 2 commits
- feat: add init file to profiler folder (#2962) · eaa03383
  hhzhang16 authored Sep 09, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eaa03383
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
04 Sep, 2025 1 commit
- test: add test for pre-deployment script (#2857) · f72dc01d
  Hongkuan Zhou authored Sep 04, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f72dc01d
02 Sep, 2025 2 commits

docs: update profiling-related docs (#2816) · 7eef9ac3

hhzhang16 authored Sep 02, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

7eef9ac3

chore: add pydantic validation for benchmark profile config (#2791) · 882ae1b4
Michael Shin authored Sep 02, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
882ae1b4

30 Aug, 2025 1 commit
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
22 Aug, 2025 1 commit
- fix: missing tokenizer args in sla_planner.py (#2667) · 268d017e
  Hongkuan Zhou authored Aug 22, 2025
  
  268d017e
21 Aug, 2025 1 commit
- fix: profiling script missing tests when kv cache is tight (#2567) · b98188c8
  Hongkuan Zhou authored Aug 21, 2025
  
  b98188c8
20 Aug, 2025 1 commit
- feat: add --tokenizer_path to profile_endpoint.py (#2550) · 59053354
  Jason Zhou authored Aug 20, 2025
  
  59053354
15 Aug, 2025 1 commit
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
12 Aug, 2025 1 commit

feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68

Hongkuan Zhou authored Aug 12, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

b4189c68

11 Aug, 2025 2 commits
- feat: profiling PVC updates for better UX (#2402) · bea92eae
  hhzhang16 authored Aug 11, 2025
  
  bea92eae
- feat: standalone profiling script for a given endpoint (#2386) · fd358991
  Hongkuan Zhou authored Aug 11, 2025
  
  fd358991
31 Jul, 2025 1 commit
- fix: support config without resource limit for profile sla script (#2201) · f3868b1f
  Hongkuan Zhou authored Jul 30, 2025
  
  f3868b1f
29 Jul, 2025 1 commit
- chore: add instructions to modify SLA to profile_sla doc; update component name (#2167) · 157714aa
  Hongkuan Zhou authored Jul 29, 2025
  
  157714aa
28 Jul, 2025 1 commit

feat: Deploy SLA planner to Kubernetes (#2135) · d23d48ba

hhzhang16 authored Jul 28, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

d23d48ba

24 Jul, 2025 1 commit

feat: deploy SLA profiler to k8s (#2030) · fe718fd2

hhzhang16 authored Jul 24, 2025


Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fe718fd2

18 Jun, 2025 1 commit

refactor: break profile_sla into different files; feat: support vllm_v1 (#1588) · 7ff10067

Hongkuan Zhou authored Jun 18, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

7ff10067

14 Jun, 2025 1 commit

feat: SLA-based Planner (#1420) · 3f53a78e

Hongkuan Zhou authored Jun 13, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

3f53a78e