Commits · a274ef820477c88e43a6a7812c826c383c4afa76 · OpenDAS / dynamo · GitLab

09 Mar, 2026 8 commits
- fix: Fix Intermittent KV router + mocker errors (#7108) · a274ef82
  jthomson04 authored Mar 09, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  a274ef82
- fix: snapshot children before process group kill to prevent GPU memory leaks (#7122) · fddbb84d
  Yuewei Na authored Mar 09, 2026
```
Signed-off-by: Yuewei Na <yna@nvidia.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  fddbb84d
- fix: use profiler DGD gen route in naive fallback mode (#7099) · 41b357d8
  Hongkuan Zhou authored Mar 09, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  41b357d8
- fix: correct planner entrypoint in profiler's planner config gen (#7095) · 8a0657cb
  Hongkuan Zhou authored Mar 09, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  8a0657cb
- test: skip flaky router mocker tests (#7087) (#7102) · e86e8b12
  Dmitry Tokarev authored Mar 09, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  e86e8b12
- fix: normalize GPUSKU to AIC system identifier (#6984) · 71f9e7a9
  hhzhang16 authored Mar 09, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  71f9e7a9
- Revert "test: skip flaky router mocker tests (#7087)" (#7092) · b6a115ba
  Dmitry Tokarev authored Mar 09, 2026
  
  b6a115ba
- test: skip flaky router mocker tests (#7087) · 48b302d3
  Anant Sharma authored Mar 09, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  48b302d3
07 Mar, 2026 1 commit
- chore: bump trtllm to 1.3.0rc5.post1 (#7040) · 25393fb3
  Harrison Saturley-Hall authored Mar 06, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  25393fb3
06 Mar, 2026 5 commits
- fix: planner e2e test config file using new CLI format (#7014) · e77646ae
  Hongkuan Zhou authored Mar 06, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  e77646ae
- chore(frontend): Remove the debug_perf flag used for perf work (#7024) · 76c96c5d
  Graham King authored Mar 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  76c96c5d
- fix: ETCD cluster unhealthy when adding new member during E2E test & fix vLLM... · 0f01e724
  Jacky authored Mar 06, 2026
```
fix: ETCD cluster unhealthy when adding new member during E2E test & fix vLLM disagg launch config changed (#6976)
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  0f01e724
- test: fix kvbm disagg determinism test on GB200 by setting the kv block size to 32 (#6980) · e02321f8
  Richard Huo authored Mar 05, 2026
  
  e02321f8
- fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) · f934744f
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f934744f
05 Mar, 2026 1 commit
- fix: revert accidental change of trtllm/multimodal_processor (#6921) · 9c6f36e9
  Qi Wang authored Mar 05, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
  9c6f36e9
04 Mar, 2026 8 commits
- fix: support TRT-LLM 1.3 apply_mm_hashes API (#6810) · d993f9d3
  zhongdaor-nv authored Mar 04, 2026
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  d993f9d3
- docs: testing and container docs update (#6806) · c55f38dc
  Keiven C authored Mar 04, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c55f38dc
- fix: exclude nixl .so files from ai-dynamo-runtime wheel (#6430) · 550464b6
  Anant Sharma authored Mar 04, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  550464b6
- fix: refactor profiler's dgd generation workflow to correctly generate mocker config (#6848) · 7c1a6238
  Hongkuan Zhou authored Mar 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  7c1a6238
- fix(frontend): vllm processor works with stream_interval > 1 (#6816) · 4e1bd700
  Graham King authored Mar 04, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e1bd700
- feat(kv-indexer): multi-model and multi-tenant isolation (#6830) · 35f99f93
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35f99f93
- chore: better error message for planner sweeping mode (#6844) · d688aa68
  Hongkuan Zhou authored Mar 03, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  d688aa68
- feat: optimize dev/local-dev Dockerfiles for source-based development (part 1) (#6743) · a60cdf59
  Keiven C authored Mar 03, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a60cdf59
03 Mar, 2026 3 commits
- ci: skip completions_only test (#6811) · 51e42e39
  KrishnanPrash authored Mar 03, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  51e42e39
- fix: pass through extra args in trtllm agg.sh launch script (#6787) · 146eb3b4
  KrishnanPrash authored Mar 02, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  146eb3b4
- fix: Fix E + PD Multimodal Flow in trtllm (#6726) · 47ed1227
  Indrajit Bhosale authored Mar 02, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  47ed1227
02 Mar, 2026 6 commits
- fix: Fix vLLM KVBM integration test (#6768) · 9d10e050
  Kris Hung authored Mar 02, 2026
  
  9d10e050
- fix(test): fix vllm disaggregated cancellation tests (#6758) · 8ed69ea2
  Tzu-Ling Kan authored Mar 02, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
```
  8ed69ea2
- test: Enable TRT-LLM graceful shutdown migration tests (#6766) · aedfc0a3
  Jacky authored Mar 02, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  aedfc0a3
- feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  07742cc2
- fix: mypy type fixes (#6730) · e7f3361e
  Tzu-Ling Kan authored Mar 02, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  e7f3361e
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
01 Mar, 2026 1 commit
- chore: fix post merge (#6704) · 1412e44b
  Dmitry Tokarev authored Mar 01, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  1412e44b
28 Feb, 2026 3 commits
- perf: Concurrent router perf improvements (#6536) · 9e5014da
  jthomson04 authored Feb 28, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  9e5014da
- feat: Add gpu info to the tests when we kill a process. (#6552) · fd035b19
  Tzu-Ling Kan authored Feb 28, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  fd035b19
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
27 Feb, 2026 4 commits
- fix(test): poll for snapshot before starting Router 2 in indexers_sync (#6707) · c68052ff
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  c68052ff
- fix: Phase out llava and make EPD single GPU (#6674) · 4ffa1082
  Indrajit Bhosale authored Feb 27, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  4ffa1082
- feat: default router_event_threads to 4 (#6672) · 55c0a769
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  55c0a769
- ci: trigger container validation dynamo on planner and frontend changes (#6680) · 05f10e93
  Anant Sharma authored Feb 27, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  05f10e93