Commits · b592269304c49ced5e138dfb43602c06a11ec4f8 · OpenDAS / dynamo

19 Dec, 2025 1 commit
- feat: approx kv router deployment example (#5037) · c75bb583
  Biswa Panda authored Dec 19, 2025
  
  c75bb583
17 Dec, 2025 1 commit
- chore: Add vllm multimodal tests to pre_merge (#4889) · fb1b4f92
  Kris Hung authored Dec 18, 2025
  
  fb1b4f92
16 Dec, 2025 1 commit

test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf

Keiven C authored Dec 16, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6da23fcf

11 Dec, 2025 3 commits
- fix: remove small --gpu-memory-utilization to avoid OOM due to vllm upgrade (#4899) · 31f31e8e
  Ziqi Fan authored Dec 11, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  31f31e8e
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- fix: Fix CUDA_VISIBLE_DEVICES for agg_multimodal_epd.sh (#4888) · 9b7152d7
  Kris Hung authored Dec 11, 2025
  
  9b7152d7
10 Dec, 2025 1 commit
- fix: Fix multimodal EPD examples for vllm version bump (#4849) · 0173d5e6
  Kris Hung authored Dec 11, 2025
  
  0173d5e6
09 Dec, 2025 1 commit
- feat: KV aware LoRA request routing for vllm (#4810) · 8559c2bd
  Biswa Panda authored Dec 09, 2025
  
  8559c2bd
08 Dec, 2025 2 commits
- feat: update examples to use public lora (#4807) · 3bad9666
  Biswa Panda authored Dec 08, 2025
  
  3bad9666
- fix: move new launch script to examples (#4800) · 8b197406
  Anant Sharma authored Dec 08, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8b197406
04 Dec, 2025 2 commits
- test: Multimodal Tool Calling vLLM Test (#4663) · 0651a4fe
  Indrajit Bhosale authored Dec 03, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0651a4fe
- feat: add lora k8s deployment example (#4714) · be67f67b
  Biswa Panda authored Dec 03, 2025
  
  be67f67b
03 Dec, 2025 2 commits
- chore: bump vLLM to 0.11.2 (#4476) · 60feb955
  Karen Chung authored Dec 03, 2025
  
  60feb955
- fix: enable LMCache metrics visibility with PROMETHEUS_MULTIPROC_DIR (#4654) · c6555852
  Keiven C authored Dec 02, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6555852
02 Dec, 2025 3 commits
- feat: Adding --dyn-endpoint-types flag (#4619) · 03070fd5
  KrishnanPrash authored Dec 02, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  03070fd5
- fix: Update agg_kvbm_router.sh to run workers on two gpus (#4643) · 262cce76
  Kris Hung authored Dec 02, 2025
  
  262cce76
- feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
  Biswa Panda authored Dec 02, 2025
  
  71f94eda
25 Nov, 2025 3 commits
- feat: Enable intel gaudi on dynamo (#4209) · d0e3b7b7
  Sihan Chen authored Nov 26, 2025
```
Signed-off-by: Spycsh <sihan.chen@intel.com>
```
  d0e3b7b7
- feat: allow dynamic port in scripts in preparation for parallel testing (part 1) (#4546) · a77558d4
  Keiven C authored Nov 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a77558d4
- feat: Add security flag to MM flow in vllm (#4556) · 550bf98c
  Indrajit Bhosale authored Nov 24, 2025
```
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  550bf98c
22 Nov, 2025 1 commit
- chore: unify LMCache UX w/ and w/o Dynamo (#4509) · 6d69e8c7
  Ziqi Fan authored Nov 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  6d69e8c7
21 Nov, 2025 1 commit

ci: Testing b64 multimodal support with real image (#4280) · e7544f19

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

e7544f19

20 Nov, 2025 3 commits
- fix: Support for msg[content] as a list (#4485) · 6767559f
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6767559f
- fix: same endpoint for tcp health check (#4494) · 55c66a63
  Biswa Panda authored Nov 19, 2025
  
  55c66a63
- fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  75bf7c9b
18 Nov, 2025 2 commits
- fix: Mark enable_kv_events=True for user-specified vLLM KVEventsConfig in scripts (#4418) · 7b967c77
  Karen Chung authored Nov 18, 2025
```
Signed-off-by: Karen Chung <karenc@nvidia.com>
```
  7b967c77
- fix: Fix port collision and pass prefill param in kvbm connector (#4411) · e3cee95f
  Kris Hung authored Nov 17, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  e3cee95f
17 Nov, 2025 1 commit

fix: workaround vllm prometheus cleanup error on shutdown (#4323) · 6afb4d5b

Keiven C authored Nov 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6afb4d5b

15 Nov, 2025 1 commit
- docs: Update vllm multimodal EPD doc (#4352) · 1e120ed0
  Kris Hung authored Nov 15, 2025
  
  1e120ed0
14 Nov, 2025 2 commits
- fix: rm dynamoNamespace from GAIE example (#4313) · 84737baf
  atchernych authored Nov 14, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
```
  84737baf
- fix(vllm): port allocation bugs leading to zmq error (#4321) · ecf6d48c
  Alec authored Nov 13, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  ecf6d48c
13 Nov, 2025 2 commits
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- chore: llama4 multimodal disagg support migration (#4213) · 4adab52d
  Ayush Agarwal authored Nov 13, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4adab52d
10 Nov, 2025 3 commits

refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) · afccc9d4

Keiven C authored Nov 10, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

afccc9d4

feat: remove PVC logic from profiler planner (#4210) · fa6a7f94

hhzhang16 authored Nov 10, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>

fa6a7f94

chore: mm epd disagg (#4151) · 06bc1580
Ayush Agarwal authored Nov 09, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
06bc1580

07 Nov, 2025 1 commit

feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) · 6bccf099

Keiven C authored Nov 07, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6bccf099

06 Nov, 2025 2 commits
- refactor: remove port reservation system in favor of manual specification (#4142) · a629b86a
  Alec authored Nov 05, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  a629b86a
- feat: Add base64 and HTTP image URL support to vLLM workers (#4114) · b73c571f
  KrishnanPrash authored Nov 05, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b73c571f
05 Nov, 2025 1 commit
- fix: update planner + docs now that profiling results are stored in /data (#4098) · 5528f3b4
  hhzhang16 authored Nov 04, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  5528f3b4