Commits · ca0cd3b18af29a359734f0eb6e560144e996fbac · OpenDAS / dynamo

10 Dec, 2025 1 commit

feat: add webUI to profiler (#4544) · ca0cd3b1

Hongkuan Zhou authored Dec 10, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

ca0cd3b1

03 Dec, 2025 3 commits
- chore: Update sgl version (#4716) · 1f3e97a0
  jthomson04 authored Dec 03, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  1f3e97a0
- test: add AIConfigurator dense model tests for Dynamo Planner Profiler (#4526) · 2f2a13a3
  Jason Zhou authored Dec 02, 2025
```
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
```
  2f2a13a3
- chore: clearer prometheus port handling in planner (#4707) · 135bce43
  Hongkuan Zhou authored Dec 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  135bce43
02 Dec, 2025 1 commit
- feat: mocker <> planner profiler (#4651) · 2b5655fd
  Hongkuan Zhou authored Dec 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2b5655fd
26 Nov, 2025 1 commit
- feat: support MQA + MoE (Qwen3 MoE) TEP/DEP in Planner Profiler (#4612) · 5652d670
  Hongkuan Zhou authored Nov 25, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  5652d670
25 Nov, 2025 2 commits

fix: update ai-dynamo[vllm] version and pin transformers (#4592) · ef0a4721
dagil-nvidia authored Nov 25, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
ef0a4721

ci: Pin transformers version to 4.57.1 (#4561) · ef8cf365

KrishnanPrash authored Nov 24, 2025


Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>

ef8cf365

18 Nov, 2025 1 commit

docs: Clean up incomplete recipes and clarify Kubernetes-only focus (#4159) · 88dfd1b3

Ben Hamm authored Nov 17, 2025


Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: atchernych <atchernych@nvidia.com>

88dfd1b3

17 Nov, 2025 1 commit
- fix: DSR1 DEP Prefill Profiling Benchmark (#4367) · cf97c0dc
  Hongkuan Zhou authored Nov 17, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cf97c0dc
14 Nov, 2025 1 commit

fix: misnamed tensorrtllm-runtime image and incorrect tag (#4289) · a4eb4e8a

Harrison Saturley-Hall authored Nov 14, 2025

Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <harrison.saturley.hall@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

a4eb4e8a

13 Nov, 2025 1 commit

feat: check for broken symlinks. add back lychee external link checker with... · 4c29d6e7

Nate Mailhot authored Nov 13, 2025


feat: check for broken symlinks. add back lychee external link checker with retries to fix failure (#4125)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>

4c29d6e7

12 Nov, 2025 1 commit
- fix: typo from mountPoint to mountPath (#4252) · a207b4be
  hhzhang16 authored Nov 12, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a207b4be
10 Nov, 2025 3 commits

feat: DynamoPlanner profiler to use hf_id for AIConfigurator 0.4.0 (#4167) · 43986372

Jason Zhou authored Nov 10, 2025


Signed-off-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
Co-authored-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>

43986372

feat: remove PVC logic from profiler planner (#4210) · fa6a7f94

hhzhang16 authored Nov 10, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>

fa6a7f94

feat: support TEP/DEP for DSR1 in SGLang MoE Planner (#4203) · 5e4a339a

Hongkuan Zhou authored Nov 10, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

5e4a339a

07 Nov, 2025 1 commit

feat: add parallelization filters (#4144) · 7750ed1a

Hongkuan Zhou authored Nov 07, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

7750ed1a

05 Nov, 2025 4 commits
- feat: add cost plot to profiler (#4003) · 0b284b63
  Hongkuan Zhou authored Nov 05, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0b284b63
- chore: trtllm use unified frontend (#4097) · 9fa8125c
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9fa8125c
- docs: disagg router docs update (#4093) · 17af7a0f
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  17af7a0f
- chore: bump ai-configurator version in container to make gradio install optional (#4106) · 83a3fe4e
  Tushar Sharma authored Nov 04, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  83a3fe4e
04 Nov, 2025 1 commit

feat: use configmap instead of PVC for profiling results (#3981) · d3706221

Hongkuan Zhou authored Nov 04, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>

d3706221

03 Nov, 2025 1 commit

feat: grab num_experts info from model info if possible (#4060) · f31a1dad

hhzhang16 authored Nov 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

f31a1dad

01 Nov, 2025 1 commit
- feat: efficient serving of multiple mockers (#3997) · 6ff49edb
  Yan Ru Pei authored Oct 31, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6ff49edb
31 Oct, 2025 2 commits
- fix: reduce max ISL when benchmarking prefill (#4030) · f2414f51
  Hongkuan Zhou authored Oct 31, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f2414f51
- refactor: move backend deploy, launch and slurm files from components to examples (#3849) · 8bd37c96
  Anant Sharma authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8bd37c96
30 Oct, 2025 1 commit
- feat: remove cluster wide logic from namespace restricted operator (#3934) · 6fc4c595
  hhzhang16 authored Oct 30, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  6fc4c595
29 Oct, 2025 1 commit
- fix: profiler sidecar and other SLA-driven autodeployment fixes (#3932) · a7b703bd
  hhzhang16 authored Oct 28, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a7b703bd
28 Oct, 2025 1 commit
- feat: mocker disagg (#3833) · cc4c3516
  Yan Ru Pei authored Oct 28, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cc4c3516
27 Oct, 2025 4 commits
- feat: turn profiling k8s jobs into sample DGDR requests (#3864) · 6a84ffd3
  hhzhang16 authored Oct 27, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  6a84ffd3
- fix: pipe AI perf streaming output to terminal in rotuer benchmarking (#3905) · 8c8922b0
  Yan Ru Pei authored Oct 27, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8c8922b0
- refactor: remove hardcoded /workspace paths across tests (#3888) · 07cf0744
  Keiven C authored Oct 27, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  07cf0744
- fix: consistent model recipes and update simplified doc (#3858) · 0757ecf1
  Biswa Panda authored Oct 27, 2025
  
  0757ecf1
24 Oct, 2025 2 commits
- fix: add the proper flag for mooncake benchmarking on router (#3878) · ee275cbf
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ee275cbf
- refactor: move engine configs out of components directory (#3772) · 8354d325
  Anant Sharma authored Oct 24, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
```
  8354d325
23 Oct, 2025 3 commits
- docs: include router benchmarking results (#3856) · 4e496691
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4e496691
- chore: restructure mocker cli args handling, to include prefill/decode (#3847) · 41ff394f
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  41ff394f
- feat: automatic profiling config generation (#3787) · a1b38af2
  Hongkuan Zhou authored Oct 23, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  a1b38af2
22 Oct, 2025 2 commits

docs: address Harry/VDR feedback + fixing broken links across repository (#3802) · c6b59045

Anish authored Oct 22, 2025


Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

c6b59045

chore: no need to publish kv events for decode vllm worker (#3819) · fb294b90
Yan Ru Pei authored Oct 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
fb294b90