Commits · 699996e4fe1ebfd84c235fb721fbae2ed705016f · OpenDAS / dynamo

30 Aug, 2025 1 commit
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
22 Aug, 2025 1 commit
- fix: missing tokenizer args in sla_planner.py (#2667) · 268d017e
  Hongkuan Zhou authored Aug 22, 2025
  
  268d017e
21 Aug, 2025 1 commit
- fix: profiling script missing tests when kv cache is tight (#2567) · b98188c8
  Hongkuan Zhou authored Aug 21, 2025
  
  b98188c8
20 Aug, 2025 1 commit
- feat: add --tokenizer_path to profile_endpoint.py (#2550) · 59053354
  Jason Zhou authored Aug 20, 2025
  
  59053354
15 Aug, 2025 1 commit
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
12 Aug, 2025 1 commit

feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68

Hongkuan Zhou authored Aug 12, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

b4189c68

11 Aug, 2025 2 commits
- feat: profiling PVC updates for better UX (#2402) · bea92eae
  hhzhang16 authored Aug 11, 2025
  
  bea92eae
- feat: standalone profiling script for a given endpoint (#2386) · fd358991
  Hongkuan Zhou authored Aug 11, 2025
  
  fd358991
31 Jul, 2025 1 commit
- fix: support config without resource limit for profile sla script (#2201) · f3868b1f
  Hongkuan Zhou authored Jul 30, 2025
  
  f3868b1f
29 Jul, 2025 1 commit
- chore: add instructions to modify SLA to profile_sla doc; update component name (#2167) · 157714aa
  Hongkuan Zhou authored Jul 29, 2025
  
  157714aa
28 Jul, 2025 1 commit

feat: Deploy SLA planner to Kubernetes (#2135) · d23d48ba

hhzhang16 authored Jul 28, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

d23d48ba

24 Jul, 2025 1 commit

feat: deploy SLA profiler to k8s (#2030) · fe718fd2

hhzhang16 authored Jul 24, 2025


Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fe718fd2

18 Jun, 2025 1 commit

refactor: break profile_sla into different files; feat: support vllm_v1 (#1588) · 7ff10067

Hongkuan Zhou authored Jun 18, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

7ff10067

14 Jun, 2025 1 commit

feat: SLA-based Planner (#1420) · 3f53a78e

Hongkuan Zhou authored Jun 13, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

3f53a78e