Commits · db49dfd216f7adf5d46d8fc69575a15388142228 · OpenDAS / dynamo

25 Mar, 2026 2 commits
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
- fix: Request Rejection busy signal passage (#7615) · db79f324
  Jacky authored Mar 24, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  db79f324
24 Mar, 2026 2 commits
- feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route,... · daa4fb04
  Tzu-Ling Kan authored Mar 24, 2026
```
feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481)
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  daa4fb04
- feat: Add GAIE nightly integration test [DEP-423] (#7458) · 8c2a4681
  atchernych authored Mar 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  8c2a4681
23 Mar, 2026 3 commits
- feat: Frontend and Runtime Request Cancellation Metrics (#7493) · e252f82d
  Jacky authored Mar 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e252f82d
- fix: ProphetPredictor next-step timestamp missing step_size fa… (#7208) · 4159c6fd
  liuhuijiayou authored Mar 24, 2026
```
Signed-off-by: liuhui <liuhui06@kuaishou.com>
Co-authored-by: liuhui <liuhui06@kuaishou.com>
```
  4159c6fd
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
20 Mar, 2026 3 commits
- feat(mocker): add offline trace replay mode [DYN-2502] (#7543) · c3908a36
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c3908a36
- feat: GPU VRAM profiler + profiled test markers for 1 GPU SGLang (part 3) (#7508) · 6ed8ba0a
  Keiven C authored Mar 20, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6ed8ba0a
- feat: [vLLM] add remote embedding loader to prefill/decode worker. Port E/P/D usage (#7507) · 4d302ab6
  GuanLuo authored Mar 19, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  4d302ab6
19 Mar, 2026 7 commits
- fix: unskip multimodal_disagg_qwen EPD test (#7523) · fa92958a
  KrishnanPrash authored Mar 19, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  fa92958a
- chore: upgrade tensorrt-llm to 1.3.0rc8 (#7504) · ba3aef8a
  Yuewei Na authored Mar 19, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  ba3aef8a
- ci: copy pyproject.toml into test images for pytest config (#7480) · ae9ffa35
  Anant Sharma authored Mar 19, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  ae9ffa35
- test: GAIE integration Unit and e2e tests (#7257) · 50af3435
  atchernych authored Mar 19, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  50af3435
- fix: increase `/dev/shm` for CI pytest containers to fix NIXL UCX segfault (#7515) · 4fc2b5e8
  KrishnanPrash authored Mar 19, 2026
  
  4fc2b5e8
- fix: restore serve test timeouts for slower CI GPUs (#7510) · 934b0669
  Keiven C authored Mar 19, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  934b0669
- feat: add NixlEmbeddingSender / NixlEmbeddingReceiver in sglang backend (#7153) · 70892fc1
  Wang, Yi authored Mar 19, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  70892fc1
18 Mar, 2026 3 commits
- feat: add --dry-run flag to preview VRAM-based test selection (#7491) · 19fc7660
  Keiven C authored Mar 18, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  19fc7660
- feat: GPU VRAM profiler via memory fraction injection + profiled test markers... · 0b20745e
  Keiven C authored Mar 18, 2026
```
feat: GPU VRAM profiler via memory fraction injection + profiled test markers (part 2 - vLLM only) (#6719)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0b20745e
- chore: add vllm omni e2e tests (#7454) · f890199f
  Ayush Agarwal authored Mar 18, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  f890199f
17 Mar, 2026 4 commits
- ci: add E/P/D multimodal CI coverage for SGLang (#7444) · d92d5c77
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  d92d5c77
- ci(trtllm): fix aggregated_multimodal_router test (#7460) · 22fb3398
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  22fb3398
- chore: unskip several multi-gpu tests and enable sglang multi-gpu tests (#7443) · 9681225a
  Dmitry Tokarev authored Mar 17, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9681225a
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
16 Mar, 2026 3 commits
- fix: remove bare pytest_asyncio import breaking pre-commit (#7453) · b77f9765
  mohammedabdulwahhab authored Mar 16, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b77f9765
- test(router): reserve contiguous zmq ports (#7448) · c5ad4a87
  Yan Ru Pei authored Mar 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c5ad4a87
- feat: flock-based failover lock for engine leader election (#6817) · 9df692c1
  mohammedabdulwahhab authored Mar 16, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9df692c1
15 Mar, 2026 3 commits
- ci: enable multi-GPU tests in PR pipeline (#7355) · 4751f769
  Anant Sharma authored Mar 15, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  4751f769
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
- chore(kv-router): remove native kv-indexer binary, use maturin-built one (#7338) · b6596c52
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b6596c52
13 Mar, 2026 5 commits
- fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) · 947939c7
  Biswa Panda authored Mar 13, 2026
  
  947939c7
- ci: fit sglang multimodal EPD test on 1 GPU (#7046) · be2f1dc1
  KrishnanPrash authored Mar 13, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  be2f1dc1
- test: generalize router test infrastructure and expand documentations (#7327) · 33604afa
  Keiven C authored Mar 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  33604afa
- feat: harden ManagedProcess teardown, add xdist-safe tests (#6670) · 608405e0
  Keiven C authored Mar 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  608405e0
- chore(deps): bump vLLM 0.16.0 → 0.17.1 (#7170) · dba69e0f
  Tzu-Ling Kan authored Mar 12, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  dba69e0f
12 Mar, 2026 3 commits
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
- feat(kv-router): package dynamo-kv-indexer binary via maturin [LLM-126] (#7194) · f80ad692
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f80ad692
- feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) · bb07b2f4
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  bb07b2f4
11 Mar, 2026 2 commits

test: pytests able to run locally now (#7219) · 4bd6299b
Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
4bd6299b

feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103) · 5d5fd243

daiyaanarfeen authored Mar 11, 2026


Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

5d5fd243