Commits · 00b64ae001d4f807b33210b47981f7b639ec9b51 · OpenDAS / dynamo · GitLab

04 Dec, 2025 11 commits
- refactor: remove legacy NATS metrics and stats_handler (#4680) · 00b64ae0
  Keiven C authored Dec 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  00b64ae0
- fix: vLLM xfer bug (#4745) · 173201f5
  Alec authored Dec 04, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  173201f5
- fix: parallel tool call indices in streaming (#4723) · 8601ccdb
  Vladislav Nosivskoy authored Dec 04, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  8601ccdb
- test: reenable router + vllm tests (#4746) · 67273aba
  Yan Ru Pei authored Dec 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  67273aba
- feat: Turn on canary health check by default (#4368) · d5800311
  Tzu-Ling Kan authored Dec 03, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d5800311
- fix: Use /proc/driver/nvidia/gpus to get PCI addresses (#4717) · 37d0fc88
  Tzu-Ling Kan authored Dec 03, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  37d0fc88
- chore: bump vLLM to 0.12.0 (#4736) · d7c11b65
  Karen Chung authored Dec 03, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
```
  d7c11b65
- feat: Add GPU discovery utilities (#4695) · c0992522
  Tzu-Ling Kan authored Dec 03, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  c0992522
- chore: no need to arc wrap client (#4741) · 5b24b429
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5b24b429
- test: Multimodal Tool Calling vLLM Test (#4663) · 0651a4fe
  Indrajit Bhosale authored Dec 03, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0651a4fe
- feat: add lora k8s deployment example (#4714) · be67f67b
  Biswa Panda authored Dec 03, 2025
  
  be67f67b
03 Dec, 2025 23 commits
- fix: copy wheel meta files in vllm dev stage for editable install (#4738) · 845a06b3
  Anant Sharma authored Dec 03, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  845a06b3
- chore: Update sgl version (#4716) · 1f3e97a0
  jthomson04 authored Dec 03, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  1f3e97a0
- chore: update deploy code owner for backend k8s examples (#4743) · ea93cb5b
  Biswa Panda authored Dec 03, 2025
  
  ea93cb5b
- feat: add more metrics in planner (#4710) · 732c1ed2
  Hongkuan Zhou authored Dec 03, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  732c1ed2
- fix: remove printing metadata json (#4737) · 96f80089
  Nate Mailhot authored Dec 03, 2025
  
  96f80089
- chore: bump vLLM to 0.11.2 (#4476) · 60feb955
  Karen Chung authored Dec 03, 2025
  
  60feb955
- chore: Arc wrap prometheus_registry in MetricsRegistry (#4677) · c5e8c4c2
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c5e8c4c2
- fix: Updates CUDA fatbin for KVBM (#4700) · 991d8c72
  Olga Andreeva authored Dec 03, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  991d8c72
- feat: add Kserve readiness endpoint support: ServerLive / ServerReady / ModelReady (#4708) · d90dc39d
  GuanLuo authored Dec 03, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  d90dc39d
- ci: publish docs automatically (#3263) · 66f319ab
  Neal Vaidya authored Dec 03, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  66f319ab
- docs: update TensorRT-LLM commit for multimodal EPD to v1.2.0rc3 (#4713) · d5a75dd8
  dagil-nvidia authored Dec 03, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  d5a75dd8
- chore(helm): disable etcd PDB by default (#4602) · b4e7829d
  c-fteixeira authored Dec 03, 2025
```
Signed-off-by: c-fteixeira <fteixeira@nvidia.com>
```
  b4e7829d
- feat: vLLM DSR1 recipe (#4463) · c81c86e4
  ptarasiewiczNV authored Dec 03, 2025
```
Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  c81c86e4
- test: remove redundant mocker e2e test in rust (#4720) · 77841e7b
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  77841e7b
- build: reorder docker layers to maximize layer cache hits (#4468) · dab2de67
  Anant Sharma authored Dec 03, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  dab2de67
- fix: adjust usage of vLLM for deprecation of 'disable_log_requests' (#4659) · db5687f5
  Julien Debache authored Dec 03, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  db5687f5
- test: add AIConfigurator dense model tests for Dynamo Planner Profiler (#4526) · 2f2a13a3
  Jason Zhou authored Dec 02, 2025
```
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
```
  2f2a13a3
- fix: enable LMCache metrics visibility with PROMETHEUS_MULTIPROC_DIR (#4654) · c6555852
  Keiven C authored Dec 02, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6555852
- docs: update aks guide (#3651) · a6a4f360
  Sertaç Özercan authored Dec 02, 2025
```
Signed-off-by: Sertac Ozercan <sozercan@gmail.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  a6a4f360
- chore: clearer prometheus port handling in planner (#4707) · 135bce43
  Hongkuan Zhou authored Dec 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  135bce43
- test: bring back the framework 1 gpu pre-merge tests + clean up pytest markers (#4698) · 7e499b5c
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e499b5c
- fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port... · 3cad926e
  Keiven C authored Dec 02, 2025
```
fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port binding, and update etcd test (#4687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3cad926e
- refactor: Replace hyphens from paths (#4701) · 769fae9e
  Tzu-Ling Kan authored Dec 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  769fae9e
02 Dec, 2025 6 commits
- feat: Extend the KV Event Consolidator to support TensorRT-LLM (#4533) · 6067c59d
  Kris Hung authored Dec 02, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  6067c59d
- fix: Fix vllm finder module path (#4691) · ca264beb
  Tzu-Ling Kan authored Dec 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  ca264beb
- fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union... · 4ace4c85
  GuanLuo authored Dec 02, 2025
```
fix: ModelDeploymentCard obtains full set of eos_token_ids by taking union from different files (#3192)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  4ace4c85
- fix: Update expected prompt for deepep test (#4704) · af9ae793
  Kris Hung authored Dec 02, 2025
  
  af9ae793
- feat: mocker <> planner profiler (#4651) · 2b5655fd
  Hongkuan Zhou authored Dec 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  2b5655fd
- feat: Adding --dyn-endpoint-types flag (#4619) · 03070fd5
  KrishnanPrash authored Dec 02, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  03070fd5