Commits · 54dcf3ade8424bf77f20c84c07f7275505e1fa69 · OpenDAS / dynamo · GitLab

16 Dec, 2025 11 commits
- feat: graceful exit leading to 500 and connection errors -... · 54dcf3ad
  Michael Feil authored Dec 16, 2025
```
feat: graceful exit leading to 500 and connection errors - liveness-return-false if-cancelled (#4914)
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  54dcf3ad
- feat: Profiler WebUI improvements -- error handling, GPU hours, style fixes,... · 6b5842ee
  hhzhang16 authored Dec 16, 2025
```
feat: Profiler WebUI improvements -- error handling, GPU hours, style fixes, preview configs (#4968)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  6b5842ee
- feat: video decoder in the frontend (#4719) · 74fcd4a9
  milesial authored Dec 16, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  74fcd4a9
- fix: Set max_tokens_in_buffer on TRT-LLM cache transceiver (#4703) · 32eaecb4
  Jacky authored Dec 16, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  32eaecb4
- chore: do not assume QUEUE_NAME for event stream anymore (#4982) · 59e6873e
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  59e6873e
- feat: Update GAIE recipe (#4761) · c26e6fb8
  atchernych authored Dec 16, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c26e6fb8
- test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf
  Keiven C authored Dec 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6da23fcf
- feat: improve sanity_check output for deployment triage (#4944) · 7d90b2d1
  Keiven C authored Dec 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  7d90b2d1
- chore: fix lychee (#4970) · 0e1efb8f
  Neal Vaidya authored Dec 15, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  0e1efb8f
- docs: consolidate multimodal docs (#4842) · 3c4b3069
  Neal Vaidya authored Dec 15, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  3c4b3069
- chore: add test for diverging prefixes (#4919) · 29ec4969
  Neal Vaidya authored Dec 15, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  29ec4969
15 Dec, 2025 7 commits
- fix(vllm): warn that stream interval is not respected for now (#4650) · bbeb2808
  Alec authored Dec 15, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  bbeb2808
- fix: Fix kvbm nixl connector for vllm upgrade (#4957) · f26dbd09
  Kris Hung authored Dec 16, 2025
  
  f26dbd09
- chore: bump minijinja to 2.14.0 (#4949) · 24ac6c15
  KrishnanPrash authored Dec 15, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  24ac6c15
- feat: add useMocker field to DGDR (#4813) · 4e6493ae
  hhzhang16 authored Dec 15, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  4e6493ae
- fix: reduce spurious resource updates (#4868) · c341ee8d
  Julien Mancuso authored Dec 15, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
```
  c341ee8d
- docs: update support matrix with build dependency version history (#4953) · 8189e854
  dagil-nvidia authored Dec 15, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  8189e854
- feat: Mistral-3-large support (#4885) · 44a2cba9
  jthomson04 authored Dec 14, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  44a2cba9
13 Dec, 2025 2 commits
- docs: router cost function mermaid (#4943) · 87112373
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  87112373
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
12 Dec, 2025 10 commits
- feat: support decentralized router with NATs core (#4921) · ef3027bd
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ef3027bd
- feat: allow user to input gpu cost in profiler webui (#4935) · b24ccd29
  Hongkuan Zhou authored Dec 12, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  b24ccd29
- chore: enable local indexers for sglang and trtllm (#4932) · c2a29f80
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c2a29f80
- fix: cleaner prefill + decode discovery (#4927) · feb49914
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb49914
- fix: Initialize logger earlier to capture startup logs (#3570) · 0de75a87
  bin.pan authored Dec 13, 2025
```
Signed-off-by: bin <bin.pan@daocloud.io>
```
  0de75a87
- fix: health check race condition by waiting for watch stream discovery (#4876) · 32bfc0f3
  Tzu-Ling Kan authored Dec 11, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  32bfc0f3
- test: remove tcp test xfail for tcp after automatic port assignments (#4916) · 44f57a22
  Biswa Panda authored Dec 11, 2025
  
  44f57a22
- feat(operator): DGD service status replica information (#4863) · aa1bc3c5
  Thomas Montfort authored Dec 11, 2025
  
  aa1bc3c5
- fix: prefill discovery (#4911) · f790e921
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f790e921
- feat: DeepSeek V3.2 chat template support (#4797) · 1efc7d63
  Vladislav Nosivskoy authored Dec 12, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  1efc7d63
11 Dec, 2025 10 commits
- feat: use os assigned free port for tcp rpc (#4891) · 64a30d3d
  Biswa Panda authored Dec 11, 2025
  
  64a30d3d
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- ci: Update the pre_merge markers to exclude gpu_2 tests running (#4909) · 82577b06
  Pavithra Vijayakrishnan authored Dec 11, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  82577b06
- test: remove pytest_runtestloop (#4886) · d0e95c39
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d0e95c39
- feat: install Run:ai model streamer for vllm (#4848) · 53cec4ac
  Guangtong Bai authored Dec 11, 2025
```
Signed-off-by: Guangtong Bai <guangtong.bai@gmail.com>
```
  53cec4ac
- fix: relax pydantic requirements (#4865) · 2ef0f5fb
  Dmitry Tokarev authored Dec 11, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  2ef0f5fb
- docs: update docs to remove KVBM cuda graph limitation (#4902) · 5c2415d8
  Kyle McGill authored Dec 11, 2025
  
  5c2415d8
- fix: remove small --gpu-memory-utilization to avoid OOM due to vllm upgrade (#4899) · 31f31e8e
  Ziqi Fan authored Dec 11, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  31f31e8e
- test: graceful shutdown for tcp req plane (#4883) · 5e96c9a8
  Biswa Panda authored Dec 11, 2025
  
  5e96c9a8