Commits · 910b587db1a605c2f70355c6963582928ffa80fa · OpenDAS / dynamo · GitLab

19 Dec, 2025 14 commits
- chore: update nixl to 0.8.0 and ucx 1.20 (#5007) · 910b587d
  Nate Mailhot authored Dec 19, 2025
```
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
```
  910b587d
- fix: update install_vllm.sh, remove accidental nixl installation (#5033) · 7641fce5
  Dmitry Tokarev authored Dec 19, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  7641fce5
- chore: update versions for 0.8.0 release (#5031) · 7436e3bc
  Anant Sharma authored Dec 19, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  7436e3bc
- docs: remove stale router diagram in trtllm docs (#5034) · 0055f2a4
  Yan Ru Pei authored Dec 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0055f2a4
- fix: make kubernetes backed discovery default (#5024) · 043c80c4
  mohammedabdulwahhab authored Dec 19, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  043c80c4
- docs: document LMCache Prometheus metrics harmless error for vLLM 0.12.0 (#5026) · 4d0b1a11
  Keiven C authored Dec 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  4d0b1a11
- ci: remove fault tolerance tests from pr checks (#5030) · bf9c93c7
  Anant Sharma authored Dec 19, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  bf9c93c7
- fix: support dynamic metadata updates in Kubernetes backed discovery (#4988) · 4106b90f
  mohammedabdulwahhab authored Dec 19, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  4106b90f
- feat: Runtime media decoder config (#5011) · d2faf0e6
  milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  d2faf0e6
- feat: add multimodal support to KV router with standalone trtllm example (#4577) · 481dc636
  zhongdaor-nv authored Dec 18, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  481dc636
- fix: Update flag for GAIE agg deployment [DEP-659] (#5027) · f17fcb15
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  f17fcb15
- test: enable Router gap detection test (#5023) · 1247fe31
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1247fe31
- refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc
  Keiven C authored Dec 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c22280cc
- test: Adding three basic KVBM integration tests for GitHub Actions CI (#5019) · cd7b1492
  Olga Andreeva authored Dec 18, 2025
  
  cd7b1492
18 Dec, 2025 21 commits
- feat: unify per-request metric tracking (#5004) · 85b5c808
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  85b5c808
- docs: Add Agg Round Robin vs Disagg KV Router Recipe (#5021) · b823575e
  Alec authored Dec 18, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  b823575e
- feat: switch to tcp as default request plane (#4845) · 18b64e90
  Biswa Panda authored Dec 18, 2025
  
  18b64e90
- feat: propagate trace context to vLLM engine (#4918) · b401a1d6
  jh-nv authored Dec 18, 2025
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  b401a1d6
- fix: Fixed CUDA VERSION value format for VLLM ARM CI job (#5018) · 676ce434
  Dmitry Tokarev authored Dec 18, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  676ce434
- fix: Don't recursively drop blocks in KVBM (#4995) · da59c6ae
  jthomson04 authored Dec 18, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  da59c6ae
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
- feat: VLLM + CUDA 13 (#4997) · 7a3b15e6
  Dmitry Tokarev authored Dec 18, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  7a3b15e6
- chore: add frontend per-request logging via on_response callback (#4965) · aaed4f3b
  nv-nedelman-1 authored Dec 18, 2025
```
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
```
  aaed4f3b
- fix: preserve root group access when overriding Docker user (#5009) · b06cc313
  Keiven C authored Dec 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  b06cc313
- feat: add explanation for circles in Profiler UI (#4998) · 06c35f2d
  hhzhang16 authored Dec 18, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  06c35f2d
- fix: ffmpeg legal alignment (#5002) · e36b7e7a
  milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  e36b7e7a
- chore: update versions to match latest release (#4966) · 5b82b8b0
  Anant Sharma authored Dec 18, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  5b82b8b0
- fix(prefill): IPv6-ready bootstrap host resolution for sglang (#3019) · 845064bc
  dmitrygx authored Dec 18, 2025
```
Signed-off-by: Dmitrii Gabor <dmitryg1709@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  845064bc
- refactor: consolidate fault_tolerance DynamoFrontendProcess, add timeouts (#5008) · f10f5942
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f10f5942
- fix: Remove debug logging from aiperf benchmarking (#5010) · e1c685b1
  Tanmay Verma authored Dec 17, 2025
  
  e1c685b1
- refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1b8869f5
- test: update lora tests (#4996) · 9be3df8f
  Pavithra Vijayakrishnan authored Dec 17, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  9be3df8f
- feat: Libfabric support (#4407) · 00b38ded
  Joe Chandler authored Dec 17, 2025
```
Signed-off-by: Joe Chandler <jchandler@glia-ai.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
```
  00b38ded
- feat(frontend): First part of Python request handling (#4999) · da0f2fb8
  Graham King authored Dec 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  da0f2fb8
- feat: Move k8 fault tolerance to nightly (#4819) · 91423c45
  Tzu-Ling Kan authored Dec 17, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  91423c45
17 Dec, 2025 5 commits
- fix: warmup for auto warmup (#4879) · b7107d00
  ishandhanani authored Dec 17, 2025
  
  b7107d00
- feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483
  Sean SH Choi authored Dec 17, 2025
```
Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  1c39e483
- feat(operator): enable maxSurge/maxUnavailable configuration for Deployment... · 7a5f70f3
  Thomas Montfort authored Dec 17, 2025
```
feat(operator): enable maxSurge/maxUnavailable configuration for Deployment backed components (#4990)
```
  7a5f70f3
- chore: Add vllm multimodal tests to pre_merge (#4889) · fb1b4f92
  Kris Hung authored Dec 18, 2025
  
  fb1b4f92
- docs: add issue-first workflow for external contributors (#4775) · e83847c0
  dagil-nvidia authored Dec 17, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  e83847c0