Commits · 9616c86f1b9f2036f5066608afb0885d7387db56 · OpenDAS / dynamo

23 Mar, 2026 1 commit
- docs: EKS Auto Mode example (#7369) · 9616c86f
  Erez Zarum authored Mar 23, 2026
```
Signed-off-by: Erez Zarum <erezz@amazon.com>
```
  9616c86f
21 Mar, 2026 1 commit
- refactor: fold SGLang multimodal processor into encode worker (#7517) · 435c8024
  KrishnanPrash authored Mar 20, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  435c8024
20 Mar, 2026 2 commits
- feat: GPU VRAM profiler + profiled test markers for 1 GPU SGLang (part 3) (#7508) · 6ed8ba0a
  Keiven C authored Mar 20, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6ed8ba0a
- feat: [vLLM] add remote embedding loader to prefill/decode worker. Port E/P/D usage (#7507) · 4d302ab6
  GuanLuo authored Mar 19, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  4d302ab6
18 Mar, 2026 1 commit

feat: GPU VRAM profiler via memory fraction injection + profiled test markers... · 0b20745e

Keiven C authored Mar 18, 2026


feat: GPU VRAM profiler via memory fraction injection + profiled test markers (part 2 - vLLM only) (#6719)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

0b20745e

17 Mar, 2026 4 commits
- ci: add E/P/D multimodal CI coverage for SGLang (#7444) · d92d5c77
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  d92d5c77
- ci(trtllm): fix aggregated_multimodal_router test (#7460) · 22fb3398
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  22fb3398
- fix: Support FastVideo example on current public version (#7431) · 1042c552
  John Pohl authored Mar 17, 2026
  
  1042c552
- feat: Enable EPP worker discovery mode (#6592) · a441aaf8
  atchernych authored Mar 16, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  a441aaf8
16 Mar, 2026 1 commit
- feat: vllm omni cli (#6788) · f81f5277
  Ayush Agarwal authored Mar 16, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  f81f5277
15 Mar, 2026 1 commit
- Fix vllm version for main ToT and a small doc update · 5e326d6f
  Dmitry Tokarev authored Mar 15, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  5e326d6f
14 Mar, 2026 1 commit
- fix: prevent DYN_SYSTEM_PORT collisions in TRT-LLM EPD launch scripts (#7366) · da783ce0
  KrishnanPrash authored Mar 13, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  da783ce0
13 Mar, 2026 2 commits
- ci: fit sglang multimodal EPD test on 1 GPU (#7046) · be2f1dc1
  KrishnanPrash authored Mar 13, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  be2f1dc1
- fix: Fix kubernetes-operator container image name in docs (#7312) · e3b10813
  Dmitry Tokarev authored Mar 12, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e3b10813
12 Mar, 2026 5 commits
- chore: remove outdated router_standalone_trtllm example and add standalone router docs (#7278) · bb43fada
  dagil-nvidia authored Mar 12, 2026
```
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
```
  bb43fada
- feat: vllm omni image to video support (#6530) · 1182e207
  Ayush Agarwal authored Mar 12, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1182e207
- docs: add FastVideo example and guide with light sidebar reorg (#7283) · 2adf8a2d
  dagil-nvidia authored Mar 12, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  2adf8a2d
- docs: add consistent startup banners to SGLang and TRT-LLM launch scripts (#7252) · 8d524d03
  Keiven C authored Mar 11, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  8d524d03
- docs: reorganize sidebar — slim Getting Started, add Resources section (#7263) · 35cbc759
  dagil-nvidia authored Mar 11, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  35cbc759
11 Mar, 2026 2 commits

feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103) · 5d5fd243

daiyaanarfeen authored Mar 11, 2026


Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

5d5fd243

feat: refactor launch scripts with shared launch_utils.sh for consistent failure handling (#7008) · 34ccc0b1
Keiven C authored Mar 11, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
34ccc0b1

10 Mar, 2026 6 commits
- docs: fix disaggregated deployment example in tracing.md (#6999) · fa474d36
  dagil-nvidia authored Mar 10, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  fa474d36
- docs: Add numbers to showcase MM router perf (#7166) · c619ce36
  Kris Hung authored Mar 10, 2026
  
  c619ce36
- fix(perf): Skip duplicate image downloads and unnecessary image processing in... · 6634f33f
  zhongdaor-nv authored Mar 10, 2026
```
fix(perf): Skip duplicate image downloads and unnecessary image processing in MM Router (vLLM) (#7080)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6634f33f
- fix: Reduce max_num_tokens in wide_ep dsr1 prefill worker (#7133) · 864de4be
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  864de4be
- feat: add an auto GPU VRAM estimator for disagg-same-GPU (#6868) · 423e4b45
  Keiven C authored Mar 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  423e4b45
- fix: Update free_gpu_memory_fraction for llama4 Maverick to avoid OOM in multinode setup (#7090) · f4e20810
  Indrajit Bhosale authored Mar 09, 2026
  
  f4e20810
06 Mar, 2026 3 commits
- fix: [DYN-2335] correct docker tag for tritonserver build (#7037) · e14be96a
  Neal Vaidya authored Mar 06, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  e14be96a
- fix: profiling data format in disagg_planner.yaml (#7019) · fb60cdc5
  Hongkuan Zhou authored Mar 06, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  fb60cdc5
- fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) · f934744f
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f934744f
05 Mar, 2026 4 commits
- chore: Remove llava-hf recipies (#6954) · 7e55a734
  Indrajit Bhosale authored Mar 05, 2026
  
  7e55a734
- chore: add ephemeral-storage requests to deploy profiles (#6723) · 876c9761
  Tushar Sharma authored Mar 05, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  876c9761
- perf: multimodal benchmark sweep (#6795) · 9780bf3a
  Qi Wang authored Mar 04, 2026
  
  9780bf3a
- fix: Skip Encoder llm creation for unsupported models in trtllm (#6866) · f0bfda1e
  Indrajit Bhosale authored Mar 04, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  f0bfda1e
04 Mar, 2026 4 commits
- fix: support TRT-LLM 1.3 apply_mm_hashes API (#6810) · d993f9d3
  zhongdaor-nv authored Mar 04, 2026
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  d993f9d3
- fix(examples): add missing --kv-transfer-config to disagg_router.yaml (#6897) · 93529753
  dagil-nvidia authored Mar 04, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  93529753
- docs(examples): add missing --kv-transfer-config to disaggregated serving README (#6898) · b356b499
  dagil-nvidia authored Mar 04, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  b356b499
- chore: Optimizations for epp interface complience (#6581) · 73a4ab31
  atchernych authored Mar 03, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  73a4ab31
03 Mar, 2026 2 commits
- fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637
  GuanLuo authored Mar 03, 2026
```
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  90d74637
- docs: delete script and add instructions (#6763) · 552ae186
  Qi Wang authored Mar 03, 2026
  
  552ae186