Commits · 6da23fcf792e6c714e7eb8a579f5b858fa27059c · OpenDAS / dynamo

16 Dec, 2025 1 commit

test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf

Keiven C authored Dec 16, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6da23fcf

11 Dec, 2025 4 commits
- fix: remove small --gpu-memory-utilization to avoid OOM due to vllm upgrade (#4899) · 31f31e8e
  Ziqi Fan authored Dec 11, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  31f31e8e
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- fix: Fix CUDA_VISIBLE_DEVICES for agg_multimodal_epd.sh (#4888) · 9b7152d7
  Kris Hung authored Dec 11, 2025
  
  9b7152d7
- chore: add gb200 fp4 8k1k (#4874) · 69817c2d
  ishandhanani authored Dec 10, 2025
  
  69817c2d
10 Dec, 2025 1 commit
- fix: Fix multimodal EPD examples for vllm version bump (#4849) · 0173d5e6
  Kris Hung authored Dec 11, 2025
  
  0173d5e6
09 Dec, 2025 2 commits
- feat: unified tracing across dynamo + sglang (#4248) · fc161924
  ishandhanani authored Dec 09, 2025
  
  fc161924
- feat: KV aware LoRA request routing for vllm (#4810) · 8559c2bd
  Biswa Panda authored Dec 09, 2025
  
  8559c2bd
08 Dec, 2025 3 commits
- feat: slurm jobs added fp4 and 8k1k (#4747) · 80dfb82c
  ishandhanani authored Dec 08, 2025
  
  80dfb82c
- feat: update examples to use public lora (#4807) · 3bad9666
  Biswa Panda authored Dec 08, 2025
  
  3bad9666
- fix: move new launch script to examples (#4800) · 8b197406
  Anant Sharma authored Dec 08, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8b197406
05 Dec, 2025 1 commit
- feat: Add python-configurable engine routes for sglang profiling (#4617) · 3bc129dc
  William Arnold authored Dec 05, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  3bc129dc
04 Dec, 2025 2 commits
- test: Multimodal Tool Calling vLLM Test (#4663) · 0651a4fe
  Indrajit Bhosale authored Dec 03, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0651a4fe
- feat: add lora k8s deployment example (#4714) · be67f67b
  Biswa Panda authored Dec 03, 2025
  
  be67f67b
03 Dec, 2025 2 commits
- chore: bump vLLM to 0.11.2 (#4476) · 60feb955
  Karen Chung authored Dec 03, 2025
  
  60feb955
- fix: enable LMCache metrics visibility with PROMETHEUS_MULTIPROC_DIR (#4654) · c6555852
  Keiven C authored Dec 02, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6555852
02 Dec, 2025 5 commits
- feat: mocker <> planner profiler (#4651) · 2b5655fd
  Hongkuan Zhou authored Dec 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2b5655fd
- feat: Adding --dyn-endpoint-types flag (#4619) · 03070fd5
  KrishnanPrash authored Dec 02, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  03070fd5
- fix: Update agg_kvbm_router.sh to run workers on two gpus (#4643) · 262cce76
  Kris Hung authored Dec 02, 2025
  
  262cce76
- feat: SGLang FP8 improvements and vLLM benchmark enhancements (#4675) · 01a634d1
  ishandhanani authored Dec 02, 2025
  
  01a634d1
- feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
  Biswa Panda authored Dec 02, 2025
  
  71f94eda
25 Nov, 2025 3 commits
- feat: Enable intel gaudi on dynamo (#4209) · d0e3b7b7
  Sihan Chen authored Nov 26, 2025
```
Signed-off-by: Spycsh <sihan.chen@intel.com>
```
  d0e3b7b7
- feat: allow dynamic port in scripts in preparation for parallel testing (part 1) (#4546) · a77558d4
  Keiven C authored Nov 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a77558d4
- feat: Add security flag to MM flow in vllm (#4556) · 550bf98c
  Indrajit Bhosale authored Nov 24, 2025
```
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  550bf98c
22 Nov, 2025 1 commit
- chore: unify LMCache UX w/ and w/o Dynamo (#4509) · 6d69e8c7
  Ziqi Fan authored Nov 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  6d69e8c7
21 Nov, 2025 1 commit

ci: Testing b64 multimodal support with real image (#4280) · e7544f19

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

e7544f19

20 Nov, 2025 4 commits
- fix: Support for msg[content] as a list (#4485) · 6767559f
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6767559f
- chore: update low latency fp8 (#4499) · 02199790
  ishandhanani authored Nov 19, 2025
  
  02199790
- fix: same endpoint for tcp health check (#4494) · 55c66a63
  Biswa Panda authored Nov 19, 2025
  
  55c66a63
- fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  75bf7c9b
19 Nov, 2025 1 commit
- ci: TRT-LLM multimodal CI (#4118) · a8e5328e
  Indrajit Bhosale authored Nov 19, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  a8e5328e
18 Nov, 2025 5 commits

fix: Mark enable_kv_events=True for user-specified vLLM KVEventsConfig in scripts (#4418) · 7b967c77
Karen Chung authored Nov 18, 2025
```
Signed-off-by: Karen Chung <karenc@nvidia.com>
```
7b967c77
fix: add kv events config in agg_router sglang example (#4391) · cf64ca7c
Vladislav Nosivskoy authored Nov 18, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
cf64ca7c
fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
c3984bc2
fix: Fix port collision and pass prefill param in kvbm connector (#4411) · e3cee95f
Kris Hung authored Nov 17, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
e3cee95f

docs: Clean up incomplete recipes and clarify Kubernetes-only focus (#4159) · 88dfd1b3

Ben Hamm authored Nov 17, 2025


Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: atchernych <atchernych@nvidia.com>

88dfd1b3

17 Nov, 2025 2 commits
- fix: workaround vllm prometheus cleanup error on shutdown (#4323) · 6afb4d5b
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6afb4d5b
- fix: fix trtllm multinode DGD (#4389) · 9f3d1b90
  Julien Mancuso authored Nov 17, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9f3d1b90
15 Nov, 2025 1 commit
- docs: Update vllm multimodal EPD doc (#4352) · 1e120ed0
  Kris Hung authored Nov 15, 2025
  
  1e120ed0
14 Nov, 2025 1 commit

fix: rm dynamoNamespace from GAIE example (#4313) · 84737baf

atchernych authored Nov 14, 2025


Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
Signed-off-by: atchernych <atchernych@nvidia.com>

84737baf