Commits · f81f5277c09a18702764150178a9c4c026ea61be · OpenDAS / dynamo

16 Mar, 2026 1 commit
- feat: vllm omni cli (#6788) · f81f5277
  Ayush Agarwal authored Mar 16, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  f81f5277
15 Mar, 2026 1 commit
- Fix vllm version for main ToT and a small doc update · 5e326d6f
  Dmitry Tokarev authored Mar 15, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  5e326d6f
12 Mar, 2026 1 commit
- feat: vllm omni image to video support (#6530) · 1182e207
  Ayush Agarwal authored Mar 12, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1182e207
11 Mar, 2026 2 commits

feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103) · 5d5fd243

daiyaanarfeen authored Mar 11, 2026


Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

5d5fd243

feat: refactor launch scripts with shared launch_utils.sh for consistent failure handling (#7008) · 34ccc0b1
Keiven C authored Mar 11, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
34ccc0b1

10 Mar, 2026 4 commits
- docs: fix disaggregated deployment example in tracing.md (#6999) · fa474d36
  dagil-nvidia authored Mar 10, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  fa474d36
- docs: Add numbers to showcase MM router perf (#7166) · c619ce36
  Kris Hung authored Mar 10, 2026
  
  c619ce36
- fix(perf): Skip duplicate image downloads and unnecessary image processing in... · 6634f33f
  zhongdaor-nv authored Mar 10, 2026
```
fix(perf): Skip duplicate image downloads and unnecessary image processing in MM Router (vLLM) (#7080)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6634f33f
- feat: add an auto GPU VRAM estimator for disagg-same-GPU (#6868) · 423e4b45
  Keiven C authored Mar 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  423e4b45
06 Mar, 2026 2 commits
- fix: profiling data format in disagg_planner.yaml (#7019) · fb60cdc5
  Hongkuan Zhou authored Mar 06, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  fb60cdc5
- fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) · f934744f
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f934744f
05 Mar, 2026 2 commits
- chore: add ephemeral-storage requests to deploy profiles (#6723) · 876c9761
  Tushar Sharma authored Mar 05, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  876c9761
- perf: multimodal benchmark sweep (#6795) · 9780bf3a
  Qi Wang authored Mar 04, 2026
  
  9780bf3a
04 Mar, 2026 1 commit
- chore: Optimizations for epp interface complience (#6581) · 73a4ab31
  atchernych authored Mar 03, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  73a4ab31
03 Mar, 2026 5 commits

fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637

GuanLuo authored Mar 03, 2026


fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

90d74637

docs: delete script and add instructions (#6763) · 552ae186
Qi Wang authored Mar 03, 2026

552ae186
docs: vLLM README container instructions and KV offloading page (#6793) · 9fe03dd8
Alec authored Mar 02, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
9fe03dd8

feat: FlexKV integration in Dynamo (#5858) · 4d7c9845

Yue Yu authored Mar 03, 2026


Signed-off-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>

4d7c9845

docs: restructure vLLM docs and add startup banners to launch scripts (#6698) · 75bf1e09

Alec authored Mar 02, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>

75bf1e09

02 Mar, 2026 5 commits
- fix: update container image to standard vllm-runtime tag (#6781) · 1bc913ef
  Biswa Panda authored Mar 02, 2026
  
  1bc913ef
- fix: Add weight: 1 to the EPP config plugins (#6756) · ee33acf3
  atchernych authored Mar 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  ee33acf3
- fix: disagg_planner.yaml using new planner CLI (#6760) · a3cf35c3
  Hongkuan Zhou authored Mar 02, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a3cf35c3
- fix(perf): add embedding transfer implementation with NIXL WRITE initiation (#6651) · 2cab0f7f
  GuanLuo authored Mar 02, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  2cab0f7f
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
27 Feb, 2026 1 commit
- chore: migrate vllm e/p/d test from gpu_2 -> gpu_1 (#6638) · b1930a61
  KrishnanPrash authored Feb 27, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b1930a61
26 Feb, 2026 1 commit

chore: add docs for vllm mm router (#6568) · 31642b96

zhongdaor-nv authored Feb 25, 2026


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

31642b96

25 Feb, 2026 6 commits
- feat: throughput-metrics-source for SLA planner + GlobalPlanner disagg scaling (#6500) · 651ef5b5
  daiyaanarfeen authored Feb 25, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
```
  651ef5b5
- docs: embedding cache in vLLM and TRT-LLM (#6555) · d5add7ff
  Qi Wang authored Feb 25, 2026
  
  d5add7ff
- fix: vllm launch script errors for disagg and spec decoding (#6562) · 35323da2
  Alec authored Feb 24, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35323da2
- fix: add explicit --kv-transfer-config to disagg prefill workers (#6554) · e3dc1793
  Tushar Sharma authored Feb 24, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e3dc1793
- feat: add --kv-transfer-config NixlConnector to disagg scripts and recipes (#6560) · eac94322
  Alec authored Feb 24, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  eac94322
- feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302) · c916cd42
  atchernych authored Feb 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c916cd42
24 Feb, 2026 3 commits

fix: restore E/P/D multimodal disagg serving and add Qwen3-VL-30B-A3B support (#6533) · 8e236375

KrishnanPrash authored Feb 24, 2026


Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

8e236375

feat: remove --connector flag for vLLM backend (LLM-90) (#6450) · 6d3b92f0

Alec authored Feb 24, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

6d3b92f0

feat: add --disaggregation-mode enum to vLLM backend (#6483) · 7893f268

Alec authored Feb 23, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

7893f268

23 Feb, 2026 1 commit
- feat: use vllm multiprocessing in multinode scenario (#6191) · 8dd6369e
  Julien Mancuso authored Feb 23, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  8dd6369e
22 Feb, 2026 1 commit

feat: add --headless mode for multi-node TP/PP in dynamo.vllm (#6204) · 4ebb244b

Alec authored Feb 22, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

4ebb244b

20 Feb, 2026 3 commits
- feat: add embedding cache to pd worker (#6061) · c82fe888
  Qi Wang authored Feb 20, 2026
  
  c82fe888
- feat: default kv-events-config to empty (align with vLLM defaults) (#6404) · 7bbacce1
  Alec authored Feb 19, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  7bbacce1
- chore: unify filesystem usage across all frameworks and workers (#6391) · d6c49779
  Ayush Agarwal authored Feb 19, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d6c49779