Commits · 934b0669fcb826243040f42fdac02c4b30c65edc · OpenDAS / dynamo

19 Mar, 2026 2 commits

fix: restore serve test timeouts for slower CI GPUs (#7510) · 934b0669

Keiven C authored Mar 19, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

934b0669

feat: add NixlEmbeddingSender / NixlEmbeddingReceiver in sglang backend (#7153) · 70892fc1

Wang, Yi authored Mar 19, 2026


Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

70892fc1

18 Mar, 2026 3 commits
- feat: add --dry-run flag to preview VRAM-based test selection (#7491) · 19fc7660
  Keiven C authored Mar 18, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  19fc7660
- feat: GPU VRAM profiler via memory fraction injection + profiled test markers... · 0b20745e
  Keiven C authored Mar 18, 2026
```
feat: GPU VRAM profiler via memory fraction injection + profiled test markers (part 2 - vLLM only) (#6719)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0b20745e
- chore: add vllm omni e2e tests (#7454) · f890199f
  Ayush Agarwal authored Mar 18, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  f890199f
17 Mar, 2026 4 commits
- ci: add E/P/D multimodal CI coverage for SGLang (#7444) · d92d5c77
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  d92d5c77
- ci(trtllm): fix aggregated_multimodal_router test (#7460) · 22fb3398
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  22fb3398
- chore: unskip several multi-gpu tests and enable sglang multi-gpu tests (#7443) · 9681225a
  Dmitry Tokarev authored Mar 17, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9681225a
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
16 Mar, 2026 3 commits
- fix: remove bare pytest_asyncio import breaking pre-commit (#7453) · b77f9765
  mohammedabdulwahhab authored Mar 16, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b77f9765
- test(router): reserve contiguous zmq ports (#7448) · c5ad4a87
  Yan Ru Pei authored Mar 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c5ad4a87
- feat: flock-based failover lock for engine leader election (#6817) · 9df692c1
  mohammedabdulwahhab authored Mar 16, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9df692c1
15 Mar, 2026 3 commits
- ci: enable multi-GPU tests in PR pipeline (#7355) · 4751f769
  Anant Sharma authored Mar 15, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  4751f769
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
- chore(kv-router): remove native kv-indexer binary, use maturin-built one (#7338) · b6596c52
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b6596c52
13 Mar, 2026 5 commits
- fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) · 947939c7
  Biswa Panda authored Mar 13, 2026
  
  947939c7
- ci: fit sglang multimodal EPD test on 1 GPU (#7046) · be2f1dc1
  KrishnanPrash authored Mar 13, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  be2f1dc1
- test: generalize router test infrastructure and expand documentations (#7327) · 33604afa
  Keiven C authored Mar 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  33604afa
- feat: harden ManagedProcess teardown, add xdist-safe tests (#6670) · 608405e0
  Keiven C authored Mar 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  608405e0
- chore(deps): bump vLLM 0.16.0 → 0.17.1 (#7170) · dba69e0f
  Tzu-Ling Kan authored Mar 12, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  dba69e0f
12 Mar, 2026 3 commits
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
- feat(kv-router): package dynamo-kv-indexer binary via maturin [LLM-126] (#7194) · f80ad692
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f80ad692
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
11 Mar, 2026 7 commits
- test: pytests able to run locally now (#7219) · 4bd6299b
  Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4bd6299b
- feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103) · 5d5fd243
  daiyaanarfeen authored Mar 11, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  5d5fd243
- test(frontend): Minimal integration test for vllm processor (#7173) · fda022b1
  Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fda022b1
- chore(test): declutter router common.py into helper and router_process modules (#7210) · 96a55928
  Yan Ru Pei authored Mar 11, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  96a55928
- fix: serialize disagg first_gen_log_probs int keys for Rust transport (#7145) · e930526b
  Yuewei Na authored Mar 10, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  e930526b
- fix: Fix mocker+router segfaults + reliability fixes (#7162) · 761e848b
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  761e848b
- chore: skip lmcache tests on cuda13 env (#7196) · 9eec94b2
  Dmitry Tokarev authored Mar 10, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  9eec94b2
10 Mar, 2026 10 commits
- feat: split monolithic requirements.txt and remove test deps from runtime image (#6656) · 3cebc864
  Anant Sharma authored Mar 10, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3cebc864
- fix: only add profiling data to mocker workers (#7164) · 14d928cb
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  14d928cb
- fix: add kv transfer config to planner vllm examples (#7163) · e4865b69
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  e4865b69
- fix(perf): Skip duplicate image downloads and unnecessary image processing in... · 6634f33f
  zhongdaor-nv authored Mar 10, 2026
```
fix(perf): Skip duplicate image downloads and unnecessary image processing in MM Router (vLLM) (#7080)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6634f33f
- ci: OPS-3802: Increase trtllm timeout, skip unsupported tests (#7104) · 06e19690
  Dillon Cullinan authored Mar 10, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  06e19690
- test: update unsupported model name after AIC increase coverage (#7161) · aeaf45f5
  Hongkuan Zhou authored Mar 10, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  aeaf45f5
- fix: Dont ignore non-zero exitcodes after running tests (#7149) · 09c09909
  Dillon Cullinan authored Mar 10, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  09c09909
- fix(mocker): align vLLM scheduler with v1 — drop watermark, LIFO preemption, retry loop (#7020) · 236cb17d
  Yan Ru Pei authored Mar 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  236cb17d
- fix(ft-tests): avoid shlex.split corrupting JSON args in ServiceSpec setters (#7012) · 6945d47e
  Tzu-Ling Kan authored Mar 09, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  6945d47e
- fix: propagate resolved backend and skip interpolation for aggregated configs (#7106) · 50818575
  hhzhang16 authored Mar 09, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  50818575