Commits · 32622b1c74e708ccf05f97930758921c9fba45f6 · OpenDAS / dynamo

"docs/backends/sglang/README.md" did not exist on "9e8f67ed0fd975bf8d9bb39fdc5e60946df34b84"

23 Feb, 2026 21 commits
- docs: add multiturn_bench README with speculative prefill demo (#6502) · 32622b1c
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  32622b1c
- docs: clarify Docker 29.x Dev Containers hang root cause and fix (#6505) · 3bfc6d9b
  Keiven C authored Feb 23, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  3bfc6d9b
- chore: revert the kvbm workaround since trtllm v1.3.0rc3 is upgraded (#6495) · 15d21760
  Richard Huo authored Feb 23, 2026
  
  15d21760
- feat: Remove Component from public (#6403) · 80cac7c1
  Tzu-Ling Kan authored Feb 23, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  80cac7c1
- feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) · cb55766c
  Thomas Montfort authored Feb 23, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  cb55766c
- feat: use vllm multiprocessing in multinode scenario (#6191) · 8dd6369e
  Julien Mancuso authored Feb 23, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  8dd6369e
- fix: remove unused deps for kvbm bindings (#6496) · f391553e
  Anant Sharma authored Feb 23, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  f391553e
- fix: Remove --retry-delay flag from skopeo (#6501) · adb95725
  Dmitry Tokarev authored Feb 23, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  adb95725
- release: automate RC build announcement (#5952) · 5c2e55c7
  Pavithra Vijayakrishnan authored Feb 23, 2026
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  5c2e55c7
- chore: use config.modality directly for multimodal init and remove incorrect fallback value (#6471) · c40f3525
  jh-nv authored Feb 23, 2026
  
  c40f3525
- feat: add standalone KV indexer with query endpoint [DYN-2164] (#6446) · 038b50d2
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  038b50d2
- fix(chrek): fix multi-GPU UUID mapping and CUDA PID discovery (#6492) · 71be641d
  Schwinn Saereesitthipitak authored Feb 23, 2026
  
  71be641d
- chore: Disabled ci-test-suite in post-merge since we run pr workflow anyways… (#6493) · 045eedeb
  Dmitry Tokarev authored Feb 23, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  045eedeb
- fix: prefix omni/diffusion CLI flags with --omni- to avoid vLLM collisions (#6476) · 43ce8608
  Alec authored Feb 23, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  43ce8608
- fix: derive kv-router discovery name from target worker component (#6475) · e66f3267
  Yan Ru Pei authored Feb 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e66f3267
- ci: add cargo-machete check for unused Rust dependencies (#6489) · 3097adb2
  Anant Sharma authored Feb 23, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3097adb2
- feat: add multimodal lora docs and deployment example for k8s (#6452) · 04a532ed
  Biswa Panda authored Feb 23, 2026
  
  04a532ed
- ci: modify buildkit router (#6480) · b230980f
  Ran Rubin authored Feb 23, 2026
  
  b230980f
- feat: add kvbm-kernels crate and upgrade cudarc to 0.19 (#6309) · 61c67804
  Ryan Olson authored Feb 23, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  61c67804
- fix(chrek): fix CI errors and replace SIGUSR2 with SIGKILL on checkpoint failure (#6478) · 673822ea
  Schwinn Saereesitthipitak authored Feb 23, 2026
  
  673822ea
- feat: Backend accept new requests during shutdown grace period (#6093) · ea86df29
  jh-nv authored Feb 22, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  ea86df29
22 Feb, 2026 3 commits

feat: add --headless mode for multi-node TP/PP in dynamo.vllm (#6204) · 4ebb244b

Alec authored Feb 22, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

4ebb244b

fix: gracefully skip NIXL UCX tests when backend unavailable (#6484) · d3ee09d7

Alec authored Feb 22, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

d3ee09d7

fix: add pre_merge markers to vLLM unit tests (#6482) · a9568455

Alec authored Feb 22, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

a9568455

21 Feb, 2026 3 commits
- fix: Multimodal flag was ignored for TRTLLM (#6468) · 8d30cd45
  William Zhang authored Feb 21, 2026
```
* Why?

Commit `5a67b246` refactored configs for the TRTLLM backend, breaking
`--modality multimodal`.

* What?

This commit fixes this bug, and adds a unit test verified to fail
without it.
```
  8d30cd45
- feat: Remove public uses of CancellationToken (#6405) · 42d69805
  Tzu-Ling Kan authored Feb 20, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  42d69805
- feat(chrek): external restore, signal-based IPC, and package refactor (#6286) · bb8fc8a4
  Schwinn Saereesitthipitak authored Feb 20, 2026
```
Co-authored-by: Dan Feigin <dfeigin@nvidia.com>
```
  bb8fc8a4
20 Feb, 2026 13 commits
- Run Fault Tolerance test jobs only in Nightly pipeline (not in post-m… (#6462) · c8423b57
  Dmitry Tokarev authored Feb 20, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  c8423b57
- test: add TensorRT-LLM multimodal EPD test for nightly CI (#6193) · da7d3e9e
  knarangN authored Feb 20, 2026
```
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  da7d3e9e
- feat(frontend): Reduce Python-side overhead in the vLLM chat path (#6437) · f91b42b9
  Graham King authored Feb 20, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f91b42b9
- fix: reintroduce helm docs autogeneration (#6459) · fd839b8d
  Julien Mancuso authored Feb 20, 2026
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  fd839b8d
- fix: Fix dev container build (#6455) · a798e08c
  William Zhang authored Feb 20, 2026
```
There were 2 bugs prior to this commit when building a TRTLLM dev
container:

- template rendering bug
- CUDA compatibility layer

The `nvidia_entrypoint.sh` script should render the second completely
unnecessary.
```
  a798e08c
- fix: Docker push retries (#6456) · 6c698b8b
  Dmitry Tokarev authored Feb 20, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  6c698b8b
- chore: cargo machete - remove unused dependencies (#6453) · 7a6283e9
  Ryan Olson authored Feb 20, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  7a6283e9
- refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440) · 9b2e8f3d
  Yongming Ding authored Feb 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  9b2e8f3d
- feat: Configurable Request Cancellation abort passage to TRT-LLM (#6445) · 41d7d549
  Jacky authored Feb 20, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  41d7d549
- feat: interleaved thinking support in reasoning parser (#6422) · d82b0050
  MatejKosec authored Feb 20, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  d82b0050
- fix: vllm omni image perf fix (#6451) · 7409bd3a
  Ayush Agarwal authored Feb 20, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  7409bd3a
- fix(recipes): change componentType from "main" to "worker" for TRT-LL… (#5788) · edc0d4b6
  mwieczorek authored Feb 20, 2026
  
  edc0d4b6
- fix: use diff temp dir for pytest (#6449) · 2baafc2a
  Dmitry Tokarev authored Feb 20, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  2baafc2a