Commits · 2887cd1ce052df20d2e4e0109ad74d2074164cfd · OpenDAS / dynamo

24 Mar, 2026 1 commit
- feat(perf): add frontend performance sweep runner with full observability (#6749) · 01bf7170
  Biswa Panda authored Mar 24, 2026
  
  01bf7170
23 Mar, 2026 1 commit
- feat(perf): add script for profiling frontend perf with nsys and flamegraph (#6748) · 585b4df7
  Biswa Panda authored Mar 23, 2026
  
  585b4df7
20 Mar, 2026 1 commit
- feat(llm): unify user-facing priority hints (#7492) · ebd06a1f
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebd06a1f
19 Mar, 2026 2 commits
- chore: upgrade tensorrt-llm to 1.3.0rc8 (#7504) · ba3aef8a
  Yuewei Na authored Mar 19, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  ba3aef8a
- ci: copy pyproject.toml into test images for pytest config (#7480) · ae9ffa35
  Anant Sharma authored Mar 19, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  ae9ffa35
16 Mar, 2026 1 commit
- chore: bump trtllm to 1.3.0rc7 for Kimi K2.5 fix (#7408) · 10e5a492
  Biswa Panda authored Mar 16, 2026
  
  10e5a492
12 Mar, 2026 2 commits
- chore: remove unused python dependencies (#7238) · 3f565053
  Anant Sharma authored Mar 12, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3f565053
- chore: update aic to v0.7.0rc15 (#7273) · bb3f6393
  Harrison Saturley-Hall authored Mar 11, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  bb3f6393
11 Mar, 2026 1 commit
- chore: update aiperf to 0.6.0 and aic v0.7.0rc14 (#7193) · 0f974b47
  Harrison Saturley-Hall authored Mar 10, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  0f974b47
10 Mar, 2026 2 commits

refactor: remove benchmark shim, use AIPerf directly (#7074) · 419e936a

Ben Hamm authored Mar 09, 2026


Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Saravana Periyasamy <saperiyasamy@nvidia.com>

419e936a

chore: bump aiperf and aiconfig to last RCs (#7138) · fc55f612
Harrison Saturley-Hall authored Mar 09, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
fc55f612

08 Mar, 2026 1 commit
- chore: bump AIC to 0.7.0rc12 (#7070) · 3bfd0f92
  Harrison Saturley-Hall authored Mar 08, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  3bfd0f92
07 Mar, 2026 1 commit
- chore: bump aic to v0.7.0rc11 (#7043) · f596945d
  Harrison Saturley-Hall authored Mar 06, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  f596945d
06 Mar, 2026 1 commit
- docs: fix step numbering in router benchmarking guide (#6988) · 84de4e8b
  dagil-nvidia authored Mar 06, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  84de4e8b
05 Mar, 2026 2 commits
- perf: multimodal benchmark sweep (#6795) · 9780bf3a
  Qi Wang authored Mar 04, 2026
  
  9780bf3a
- docs(router): add tuning guideline for output block tracking (#6911) · 5139f688
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5139f688
03 Mar, 2026 1 commit
- fix: auto-scale request count in benchmarks (#6777) · 8bd5966b
  Yongming Ding authored Mar 02, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  8bd5966b
02 Mar, 2026 3 commits
- fix(perf): add embedding transfer implementation with NIXL WRITE initiation (#6651) · 2cab0f7f
  GuanLuo authored Mar 02, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  2cab0f7f
- feat(perf): add BPF for frontend perf tracing (#6737) · 35a796a3
  Biswa Panda authored Mar 02, 2026
  
  35a796a3
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
27 Feb, 2026 1 commit
- fix: fix docs links (#6702) · 57b55d88
  Dmitry Tokarev authored Feb 27, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  57b55d88
26 Feb, 2026 2 commits
- chore: update aiconfigurator commit to use AIC 0.7.0 RC5 (#6618) · ab63b8b6
  Jason Zhou authored Feb 26, 2026
  
  ab63b8b6
- refactor: move core logics of DPP -> AIC and support static profiling (#6285) · 4c648b11
  Hongkuan Zhou authored Feb 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  4c648b11
25 Feb, 2026 3 commits
- chore: Upgrade to tensorrt-llm==1.3.0rc5 (#6579) · 8483e4a0
  Yuewei Na authored Feb 25, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  8483e4a0
- fix: guarantee RouterRequestMetrics availability & documentation updates (#6558) · ff06b17e
  Keiven C authored Feb 25, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  ff06b17e
- test: introduce multimodal benchmark toolkit (#6330) · 5a4c96db
  Qi Wang authored Feb 24, 2026
  
  5a4c96db
24 Feb, 2026 3 commits
- chore: use aic release/0.7.0 (#6494) · 4ea80e95
  Jason Zhou authored Feb 24, 2026
  
  4ea80e95
- feat: add --disaggregation-mode enum to vLLM backend (#6483) · 7893f268
  Alec authored Feb 23, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  7893f268
- fix: fold scheduling into queue so backpressure actually works (#6470) · 0cb1d733
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  0cb1d733
20 Feb, 2026 1 commit
- feat: default kv-events-config to empty (align with vLLM defaults) (#6404) · 7bbacce1
  Alec authored Feb 19, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  7bbacce1
19 Feb, 2026 2 commits

feat: use embedding transfer classes for EPD (#6223) · a2a6917f
GuanLuo authored Feb 19, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
a2a6917f

chore: Upgrade to tensorrt-llm==1.3.0rc3 (#6402) · 9a15730a

Yuewei Na authored Feb 19, 2026


Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>

9a15730a

15 Feb, 2026 1 commit

feat: speculative prefill (#6230) · 4ede59a2

Yan Ru Pei authored Feb 15, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

4ede59a2

13 Feb, 2026 1 commit

feat: router priority queue (#6010) · bc514fbe

Yan Ru Pei authored Feb 12, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

bc514fbe

12 Feb, 2026 2 commits
- feat: support AIC DGD gen call (WILL BREAK DGDR) (#6216) · a04b5631
  Hongkuan Zhou authored Feb 12, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a04b5631
- docs: migrate Fern docs from fern/ into docs/ (#6206) · 39d645e5
  Jonathan Tong authored Feb 11, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
```
  39d645e5
10 Feb, 2026 2 commits
- fix: scale synthesized data length correctly for expected cache hit stats (#6117) · 8707dc2c
  Karen Chung authored Feb 10, 2026
  
  8707dc2c
- fix: use actual service names for profiler logs and handle FileNotFoundError correctly (#6112) · 1aab7f6b
  hhzhang16 authored Feb 10, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  1aab7f6b
09 Feb, 2026 1 commit

fix: profiler deployment timeout handling for MoE models (#6086) · 67329d10

MatejKosec authored Feb 09, 2026

Wrap wait_for_deployment_ready() in try/except TimeoutError for both prefill and decode profiling sweeps
On timeout: log error, record via add_profiling_error(), clean up the timed-out deployment, and continue to the next parallelization mapping
Previously, a single deployment timeout would crash the entire profiler job

67329d10

06 Feb, 2026 1 commit
- feat: NAT telemetry conversion (#6022) · 5035447f
  Yan Ru Pei authored Feb 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5035447f