Commits · ae770ad75d5de60f7ecbada854eab71edfa762cc · OpenDAS / dynamo

10 Mar, 2026 1 commit
- feat: add an auto GPU VRAM estimator for disagg-same-GPU (#6868) · 423e4b45
  Keiven C authored Mar 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  423e4b45
06 Mar, 2026 2 commits
- fix: profiling data format in disagg_planner.yaml (#7019) · fb60cdc5
  Hongkuan Zhou authored Mar 06, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  fb60cdc5
- fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) · f934744f
  Yan Ru Pei authored Mar 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f934744f
05 Mar, 2026 2 commits
- chore: add ephemeral-storage requests to deploy profiles (#6723) · 876c9761
  Tushar Sharma authored Mar 05, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  876c9761
- perf: multimodal benchmark sweep (#6795) · 9780bf3a
  Qi Wang authored Mar 04, 2026
  
  9780bf3a
04 Mar, 2026 1 commit
- chore: Optimizations for epp interface complience (#6581) · 73a4ab31
  atchernych authored Mar 03, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  73a4ab31
03 Mar, 2026 5 commits

fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637

GuanLuo authored Mar 03, 2026


fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

90d74637

docs: delete script and add instructions (#6763) · 552ae186
Qi Wang authored Mar 03, 2026

552ae186
docs: vLLM README container instructions and KV offloading page (#6793) · 9fe03dd8
Alec authored Mar 02, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
9fe03dd8

feat: FlexKV integration in Dynamo (#5858) · 4d7c9845

Yue Yu authored Mar 03, 2026


Signed-off-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>

4d7c9845

docs: restructure vLLM docs and add startup banners to launch scripts (#6698) · 75bf1e09

Alec authored Mar 02, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>

75bf1e09

02 Mar, 2026 5 commits
- fix: update container image to standard vllm-runtime tag (#6781) · 1bc913ef
  Biswa Panda authored Mar 02, 2026
  
  1bc913ef
- fix: Add weight: 1 to the EPP config plugins (#6756) · ee33acf3
  atchernych authored Mar 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  ee33acf3
- fix: disagg_planner.yaml using new planner CLI (#6760) · a3cf35c3
  Hongkuan Zhou authored Mar 02, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a3cf35c3
- fix(perf): add embedding transfer implementation with NIXL WRITE initiation (#6651) · 2cab0f7f
  GuanLuo authored Mar 02, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  2cab0f7f
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
27 Feb, 2026 1 commit
- chore: migrate vllm e/p/d test from gpu_2 -> gpu_1 (#6638) · b1930a61
  KrishnanPrash authored Feb 27, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b1930a61
26 Feb, 2026 1 commit

chore: add docs for vllm mm router (#6568) · 31642b96

zhongdaor-nv authored Feb 25, 2026


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

31642b96

25 Feb, 2026 6 commits
- feat: throughput-metrics-source for SLA planner + GlobalPlanner disagg scaling (#6500) · 651ef5b5
  daiyaanarfeen authored Feb 25, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
```
  651ef5b5
- docs: embedding cache in vLLM and TRT-LLM (#6555) · d5add7ff
  Qi Wang authored Feb 25, 2026
  
  d5add7ff
- fix: vllm launch script errors for disagg and spec decoding (#6562) · 35323da2
  Alec authored Feb 24, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35323da2
- fix: add explicit --kv-transfer-config to disagg prefill workers (#6554) · e3dc1793
  Tushar Sharma authored Feb 24, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e3dc1793
- feat: add --kv-transfer-config NixlConnector to disagg scripts and recipes (#6560) · eac94322
  Alec authored Feb 24, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  eac94322
- feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302) · c916cd42
  atchernych authored Feb 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c916cd42
24 Feb, 2026 3 commits

fix: restore E/P/D multimodal disagg serving and add Qwen3-VL-30B-A3B support (#6533) · 8e236375

KrishnanPrash authored Feb 24, 2026


Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

8e236375

feat: remove --connector flag for vLLM backend (LLM-90) (#6450) · 6d3b92f0

Alec authored Feb 24, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

6d3b92f0

feat: add --disaggregation-mode enum to vLLM backend (#6483) · 7893f268

Alec authored Feb 23, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

7893f268

23 Feb, 2026 1 commit
- feat: use vllm multiprocessing in multinode scenario (#6191) · 8dd6369e
  Julien Mancuso authored Feb 23, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  8dd6369e
22 Feb, 2026 1 commit

feat: add --headless mode for multi-node TP/PP in dynamo.vllm (#6204) · 4ebb244b

Alec authored Feb 22, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

4ebb244b

20 Feb, 2026 4 commits
- feat: add embedding cache to pd worker (#6061) · c82fe888
  Qi Wang authored Feb 20, 2026
  
  c82fe888
- feat: default kv-events-config to empty (align with vLLM defaults) (#6404) · 7bbacce1
  Alec authored Feb 19, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  7bbacce1
- chore: unify filesystem usage across all frameworks and workers (#6391) · d6c49779
  Ayush Agarwal authored Feb 19, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d6c49779
- feat: vllm omni text to video generation pipeline (#6104) · 6dd3ce2e
  Ayush Agarwal authored Feb 19, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  6dd3ce2e
19 Feb, 2026 1 commit
- feat: Add runtime.endpoint() method to eliminate namespace chaining (#6386) · 0ce3461a
  Tzu-Ling Kan authored Feb 19, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  0ce3461a
18 Feb, 2026 2 commits
- refactor: introduce worker factory in vLLM multimodal (#6060) · 4d0380d5
  Qi Wang authored Feb 18, 2026
  
  4d0380d5
- refactor: delete handlers and disagg EC producer/consumer (#6051) · d2a57839
  Qi Wang authored Feb 17, 2026
  
  d2a57839
14 Feb, 2026 1 commit

feat: mm aware routing for vllm (#6235) · 815b1291

zhongdaor-nv authored Feb 13, 2026


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>

815b1291

12 Feb, 2026 1 commit
- docs: migrate Fern docs from fern/ into docs/ (#6206) · 39d645e5
  Jonathan Tong authored Feb 11, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
```
  39d645e5
11 Feb, 2026 1 commit
- chore: Templating Feedback Followup (#6125) · 3188c70a
  Dillon Cullinan authored Feb 11, 2026
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  3188c70a
10 Feb, 2026 1 commit
- fix: llama4 vllm agg multimodal script (#6103) · 120ae649
  Indrajit Bhosale authored Feb 10, 2026
  
  120ae649