Commits · d0e3b7b7c342dc870c4b87331cbb3a619b9c443d · OpenDAS / dynamo

25 Nov, 2025 3 commits
- feat: Enable intel gaudi on dynamo (#4209) · d0e3b7b7
  Sihan Chen authored Nov 26, 2025
```
Signed-off-by: Spycsh <sihan.chen@intel.com>
```
  d0e3b7b7
- fix: Fix vllm MM aggregated mode Corner Case (#4583) · c90e3dff
  Indrajit Bhosale authored Nov 25, 2025
  
  c90e3dff
- feat: Add security flag to MM flow in vllm (#4556) · 550bf98c
  Indrajit Bhosale authored Nov 24, 2025
```
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  550bf98c
22 Nov, 2025 2 commits

chore: upgrade trtllm 1.2.0rc2 (#4405) · 9b8b9988

Dmitry Tokarev authored Nov 21, 2025


Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Kyle McGill <kmcgill@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>

9b8b9988

chore: unify LMCache UX w/ and w/o Dynamo (#4509) · 6d69e8c7
Ziqi Fan authored Nov 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
6d69e8c7

21 Nov, 2025 2 commits
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- fix: set `SGLANG_BLOCK_NONZERO_RANK_CHILDREN` to be no-op (#4527) · 6b432625
  ishandhanani authored Nov 20, 2025
  
  6b432625
20 Nov, 2025 1 commit
- fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  75bf7c9b
19 Nov, 2025 3 commits
- feat: Enable autodeploy as a backend for TRT-LLM (#4347) · fe21d3dd
  William Zhang authored Nov 19, 2025
```
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
```
  fe21d3dd
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- fix: Allow users to set `--kv-transfer-config` for vLLM (#4317) · 45529d06
  Joe Chandler authored Nov 18, 2025
```
Signed-off-by: Joe Chandler <jchandler@glia-ai.com>
```
  45529d06
18 Nov, 2025 7 commits
- feat: Support a dynamic default max_tokens for VLLM backend (#4156) · 58405177
  bin.pan authored Nov 19, 2025
```
Signed-off-by: bin <bin.pan@daocloud.io>
```
  58405177
- fix: respect router env vars in frontend configuration (#4431) · c65f1ac0
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  c65f1ac0
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
- fix: Mark enable_kv_events=True for user-specified vLLM KVEventsConfig in scripts (#4418) · 7b967c77
  Karen Chung authored Nov 18, 2025
```
Signed-off-by: Karen Chung <karenc@nvidia.com>
```
  7b967c77
- feat: mocker can use planner profile data (#4422) · fc2ad4eb
  Yan Ru Pei authored Nov 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  fc2ad4eb
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
- fix: Fix port collision and pass prefill param in kvbm connector (#4411) · e3cee95f
  Kris Hung authored Nov 17, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  e3cee95f
17 Nov, 2025 3 commits
- fix: workaround vllm prometheus cleanup error on shutdown (#4323) · 6afb4d5b
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6afb4d5b
- feat: convert profiler perf data for mocker to use (#4370) · 24af5a33
  Hongkuan Zhou authored Nov 17, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  24af5a33
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
14 Nov, 2025 3 commits
- feat: Use try-catch block for import to avoid error (#4339) · 9a765d6d
  Tzu-Ling Kan authored Nov 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  9a765d6d
- fix(sglang): enable metrics on multi-node setups (#4238) · 34dd7ee7
  ishandhanani authored Nov 14, 2025
  
  34dd7ee7
- fix(vllm): port allocation bugs leading to zmq error (#4321) · ecf6d48c
  Alec authored Nov 13, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  ecf6d48c
13 Nov, 2025 3 commits
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c
  Keiven C authored Nov 13, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  381c428c
- feat: `--config` file support in sglang (#4272) · d392bbdd
  ishandhanani authored Nov 12, 2025
  
  d392bbdd
11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
10 Nov, 2025 3 commits
- refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) · afccc9d4
  Keiven C authored Nov 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  afccc9d4
- feat: disable kv events in vLLM when lora is enabled (#4128) · 7802f969
  Biswa Panda authored Nov 10, 2025
  
  7802f969
- chore: mm epd disagg (#4151) · 06bc1580
  Ayush Agarwal authored Nov 09, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  06bc1580
08 Nov, 2025 1 commit
- chore: relax NullStatLogger.record signature (#4164) · d3b5e9f2
  Tzu-Ling Kan authored Nov 07, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d3b5e9f2
07 Nov, 2025 2 commits
- feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) · 6bccf099
  Keiven C authored Nov 07, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6bccf099
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
06 Nov, 2025 2 commits
- refactor: remove port reservation system in favor of manual specification (#4142) · a629b86a
  Alec authored Nov 05, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  a629b86a
- feat: Add base64 and HTTP image URL support to vLLM workers (#4114) · b73c571f
  KrishnanPrash authored Nov 05, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b73c571f
05 Nov, 2025 2 commits
- fix: Remove hard dep on kvbm (#4127) · 1a9aeab4
  Kris Hung authored Nov 05, 2025
  
  1a9aeab4
- chore: trtllm use unified frontend (#4097) · 9fa8125c
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9fa8125c
04 Nov, 2025 2 commits

feat: use configmap instead of PVC for profiling results (#3981) · d3706221

Hongkuan Zhou authored Nov 04, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>

d3706221

fix: add prefill metrics support for TensorRT-LLM disaggregated mode (#3983) · ba51c683

Keiven C authored Nov 04, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

ba51c683