Commits · c6555852ee9f4b209f853fa6b647d073111ff844 · OpenDAS / dynamo

03 Dec, 2025 1 commit

fix: enable LMCache metrics visibility with PROMETHEUS_MULTIPROC_DIR (#4654) · c6555852

Keiven C authored Dec 02, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

c6555852

02 Dec, 2025 5 commits
- feat: mocker <> planner profiler (#4651) · 2b5655fd
  Hongkuan Zhou authored Dec 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2b5655fd
- feat: Adding --dyn-endpoint-types flag (#4619) · 03070fd5
  KrishnanPrash authored Dec 02, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  03070fd5
- fix: Update agg_kvbm_router.sh to run workers on two gpus (#4643) · 262cce76
  Kris Hung authored Dec 02, 2025
  
  262cce76
- feat: SGLang FP8 improvements and vLLM benchmark enhancements (#4675) · 01a634d1
  ishandhanani authored Dec 02, 2025
  
  01a634d1
- feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
  Biswa Panda authored Dec 02, 2025
  
  71f94eda
25 Nov, 2025 3 commits
- feat: Enable intel gaudi on dynamo (#4209) · d0e3b7b7
  Sihan Chen authored Nov 26, 2025
```
Signed-off-by: Spycsh <sihan.chen@intel.com>
```
  d0e3b7b7
- feat: allow dynamic port in scripts in preparation for parallel testing (part 1) (#4546) · a77558d4
  Keiven C authored Nov 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a77558d4
- feat: Add security flag to MM flow in vllm (#4556) · 550bf98c
  Indrajit Bhosale authored Nov 24, 2025
```
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  550bf98c
22 Nov, 2025 1 commit
- chore: unify LMCache UX w/ and w/o Dynamo (#4509) · 6d69e8c7
  Ziqi Fan authored Nov 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  6d69e8c7
21 Nov, 2025 1 commit

ci: Testing b64 multimodal support with real image (#4280) · e7544f19

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

e7544f19

20 Nov, 2025 4 commits
- fix: Support for msg[content] as a list (#4485) · 6767559f
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6767559f
- chore: update low latency fp8 (#4499) · 02199790
  ishandhanani authored Nov 19, 2025
  
  02199790
- fix: same endpoint for tcp health check (#4494) · 55c66a63
  Biswa Panda authored Nov 19, 2025
  
  55c66a63
- fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  75bf7c9b
19 Nov, 2025 1 commit
- ci: TRT-LLM multimodal CI (#4118) · a8e5328e
  Indrajit Bhosale authored Nov 19, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  a8e5328e
18 Nov, 2025 5 commits

fix: Mark enable_kv_events=True for user-specified vLLM KVEventsConfig in scripts (#4418) · 7b967c77
Karen Chung authored Nov 18, 2025
```
Signed-off-by: Karen Chung <karenc@nvidia.com>
```
7b967c77
fix: add kv events config in agg_router sglang example (#4391) · cf64ca7c
Vladislav Nosivskoy authored Nov 18, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
cf64ca7c
fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
c3984bc2
fix: Fix port collision and pass prefill param in kvbm connector (#4411) · e3cee95f
Kris Hung authored Nov 17, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
e3cee95f

docs: Clean up incomplete recipes and clarify Kubernetes-only focus (#4159) · 88dfd1b3

Ben Hamm authored Nov 17, 2025


Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: atchernych <atchernych@nvidia.com>

88dfd1b3

17 Nov, 2025 2 commits
- fix: workaround vllm prometheus cleanup error on shutdown (#4323) · 6afb4d5b
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6afb4d5b
- fix: fix trtllm multinode DGD (#4389) · 9f3d1b90
  Julien Mancuso authored Nov 17, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9f3d1b90
15 Nov, 2025 1 commit
- docs: Update vllm multimodal EPD doc (#4352) · 1e120ed0
  Kris Hung authored Nov 15, 2025
  
  1e120ed0
14 Nov, 2025 3 commits

fix: rm dynamoNamespace from GAIE example (#4313) · 84737baf

atchernych authored Nov 14, 2025


Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
Signed-off-by: atchernych <atchernych@nvidia.com>

84737baf

fix: misnamed tensorrtllm-runtime image and incorrect tag (#4289) · a4eb4e8a

Harrison Saturley-Hall authored Nov 14, 2025

Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <harrison.saturley.hall@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

a4eb4e8a

fix(vllm): port allocation bugs leading to zmq error (#4321) · ecf6d48c
Alec authored Nov 13, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
ecf6d48c

13 Nov, 2025 2 commits
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- chore: llama4 multimodal disagg support migration (#4213) · 4adab52d
  Ayush Agarwal authored Nov 13, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4adab52d
12 Nov, 2025 2 commits
- feat: agg support + solidfy fp8 configs (#3886) · f8219b12
  ishandhanani authored Nov 12, 2025
  
  f8219b12
- feat: add --enable-otel flag to SGLang launch scripts (#4243) · 5fd96a23
  ishandhanani authored Nov 11, 2025
  
  5fd96a23
10 Nov, 2025 3 commits

refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) · afccc9d4

Keiven C authored Nov 10, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

afccc9d4

feat: remove PVC logic from profiler planner (#4210) · fa6a7f94

hhzhang16 authored Nov 10, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>

fa6a7f94

chore: mm epd disagg (#4151) · 06bc1580
Ayush Agarwal authored Nov 09, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
06bc1580

07 Nov, 2025 1 commit

feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) · 6bccf099

Keiven C authored Nov 07, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6bccf099

06 Nov, 2025 2 commits
- refactor: remove port reservation system in favor of manual specification (#4142) · a629b86a
  Alec authored Nov 05, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  a629b86a
- feat: Add base64 and HTTP image URL support to vLLM workers (#4114) · b73c571f
  KrishnanPrash authored Nov 05, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b73c571f
05 Nov, 2025 2 commits
- chore: trtllm use unified frontend (#4097) · 9fa8125c
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9fa8125c
- fix: update planner + docs now that profiling results are stored in /data (#4098) · 5528f3b4
  hhzhang16 authored Nov 04, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  5528f3b4
04 Nov, 2025 1 commit

fix: add prefill metrics support for TensorRT-LLM disaggregated mode (#3983) · ba51c683

Keiven C authored Nov 04, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

ba51c683