Commits · 85b5c808ac44237d185db4d13db2dfdf7dc8d8c3 · OpenDAS / dynamo · GitLab

18 Dec, 2025 21 commits
- feat: unify per-request metric tracking (#5004) · 85b5c808
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  85b5c808
- docs: Add Agg Round Robin vs Disagg KV Router Recipe (#5021) · b823575e
  Alec authored Dec 18, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  b823575e
- feat: switch to tcp as default request plane (#4845) · 18b64e90
  Biswa Panda authored Dec 18, 2025
  
  18b64e90
- feat: propagate trace context to vLLM engine (#4918) · b401a1d6
  jh-nv authored Dec 18, 2025
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  b401a1d6
- fix: Fixed CUDA VERSION value format for VLLM ARM CI job (#5018) · 676ce434
  Dmitry Tokarev authored Dec 18, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  676ce434
- fix: Don't recursively drop blocks in KVBM (#4995) · da59c6ae
  jthomson04 authored Dec 18, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  da59c6ae
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
- feat: VLLM + CUDA 13 (#4997) · 7a3b15e6
  Dmitry Tokarev authored Dec 18, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  7a3b15e6
- chore: add frontend per-request logging via on_response callback (#4965) · aaed4f3b
  nv-nedelman-1 authored Dec 18, 2025
```
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
```
  aaed4f3b
- fix: preserve root group access when overriding Docker user (#5009) · b06cc313
  Keiven C authored Dec 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  b06cc313
- feat: add explanation for circles in Profiler UI (#4998) · 06c35f2d
  hhzhang16 authored Dec 18, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  06c35f2d
- fix: ffmpeg legal alignment (#5002) · e36b7e7a
  milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  e36b7e7a
- chore: update versions to match latest release (#4966) · 5b82b8b0
  Anant Sharma authored Dec 18, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  5b82b8b0
- fix(prefill): IPv6-ready bootstrap host resolution for sglang (#3019) · 845064bc
  dmitrygx authored Dec 18, 2025
```
Signed-off-by: Dmitrii Gabor <dmitryg1709@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  845064bc
- refactor: consolidate fault_tolerance DynamoFrontendProcess, add timeouts (#5008) · f10f5942
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f10f5942
- fix: Remove debug logging from aiperf benchmarking (#5010) · e1c685b1
  Tanmay Verma authored Dec 17, 2025
  
  e1c685b1
- refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1b8869f5
- test: update lora tests (#4996) · 9be3df8f
  Pavithra Vijayakrishnan authored Dec 17, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  9be3df8f
- feat: Libfabric support (#4407) · 00b38ded
  Joe Chandler authored Dec 17, 2025
```
Signed-off-by: Joe Chandler <jchandler@glia-ai.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  00b38ded
- feat(frontend): First part of Python request handling (#4999) · da0f2fb8
  Graham King authored Dec 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  da0f2fb8
- feat: Move k8 fault tolerance to nightly (#4819) · 91423c45
  Tzu-Ling Kan authored Dec 17, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  91423c45
17 Dec, 2025 10 commits
- fix: warmup for auto warmup (#4879) · b7107d00
  ishandhanani authored Dec 17, 2025
  
  b7107d00
- feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483
  Sean SH Choi authored Dec 17, 2025
```
Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  1c39e483
- feat(operator): enable maxSurge/maxUnavailable configuration for Deployment... · 7a5f70f3
  Thomas Montfort authored Dec 17, 2025
```
feat(operator): enable maxSurge/maxUnavailable configuration for Deployment backed components (#4990)
```
  7a5f70f3
- chore: Add vllm multimodal tests to pre_merge (#4889) · fb1b4f92
  Kris Hung authored Dec 18, 2025
  
  fb1b4f92
- docs: add issue-first workflow for external contributors (#4775) · e83847c0
  dagil-nvidia authored Dec 17, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  e83847c0
- ci: OPS-2557: Enable deploy tests now that we have better layer deduplication (#4841) · 181ec2ba
  Dillon Cullinan authored Dec 17, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  181ec2ba
- fix: make gap detection work e2e (#4993) · 0fba01c2
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0fba01c2
- test: Add pre-download model test that run at beginning avoiding individual test timeout (#4989) · 54636097
  Jacky authored Dec 16, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  54636097
- refactor: make hostnames more descriptive and simplify dns check command (#4551) · 6b8bb99a
  Xavier Chang authored Dec 17, 2025
```
Signed-off-by: Xavier Chang <xuzhengc@nvidia.com>
```
  6b8bb99a
- feat: Pass tool definitions to parsers (#4948) · ff7aea54
  William Zhang authored Dec 16, 2025
```
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
```
  ff7aea54
16 Dec, 2025 9 commits
- feat(frontend): Well-known prefix for validation errors (#4984) · 7043707e
  Graham King authored Dec 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7043707e
- feat: graceful exit leading to 500 and connection errors -... · 54dcf3ad
  Michael Feil authored Dec 16, 2025
```
feat: graceful exit leading to 500 and connection errors - liveness-return-false if-cancelled (#4914)
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  54dcf3ad
- feat: Profiler WebUI improvements -- error handling, GPU hours, style fixes,... · 6b5842ee
  hhzhang16 authored Dec 16, 2025
```
feat: Profiler WebUI improvements -- error handling, GPU hours, style fixes, preview configs (#4968)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  6b5842ee
- feat: video decoder in the frontend (#4719) · 74fcd4a9
  milesial authored Dec 16, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  74fcd4a9
- fix: Set max_tokens_in_buffer on TRT-LLM cache transceiver (#4703) · 32eaecb4
  Jacky authored Dec 16, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  32eaecb4
- chore: do not assume QUEUE_NAME for event stream anymore (#4982) · 59e6873e
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  59e6873e
- feat: Update GAIE recipe (#4761) · c26e6fb8
  atchernych authored Dec 16, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c26e6fb8
- test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf
  Keiven C authored Dec 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6da23fcf
- feat: improve sanity_check output for deployment triage (#4944) · 7d90b2d1
  Keiven C authored Dec 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  7d90b2d1