Commits · 2d0dab7413168e9a4e9e079f71b8a99f51f28808 · OpenDAS / dynamo

"tests/vscode:/vscode.git/clone" did not exist on "2660b9289c1f9e26ae65a247ceac2b9add52fa90"

10 Oct, 2025 16 commits
- feat: Sglang Request cancellation (#3465) · 2d0dab74
  Indrajit Bhosale authored Oct 10, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  2d0dab74
- test: unit test for Router slot manager (#3559) · 6e8529fd
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6e8529fd
- ci: TRTLLM & SGLang Unit Tests (for --custom-jinja-template) (#3472) · a3d46840
  KrishnanPrash authored Oct 10, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  a3d46840
- chore: Remove model_config from LocalModel (#3558) · 0e0218ff
  Graham King authored Oct 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0e0218ff
- chore: upgrade nixl to 0.6.0 (#3550) · 5c69c119
  Richard Huo authored Oct 10, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  5c69c119
- test: Update multimodal sglang response validation to be more consistent (#3552) · a90ada15
  Ryan McCormick authored Oct 10, 2025
  
  a90ada15
- docs: Add tool calling usage guide (#2866) · c9da2bf8
  Ayush Agarwal authored Oct 10, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  c9da2bf8
- feat: add Rust-to-Python const code generator for prometheus_names.py (#3425) · f2ba58e5
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f2ba58e5
- feat: add KVBM host to disk metrics | clean up dashboard (#3534) · ca674098
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  ca674098
- chore: remove deprecated nvext parameters for 6.0 (#3551) · b954a249
  ryan-lempka authored Oct 10, 2025
  
  b954a249
- chore: use Rc to do reference counting in Router slot manager (#3545) · 227846f2
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  227846f2
- feat: add disk offloading filtering in KVBM (#3532) · b94ecd16
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  b94ecd16
- feat: Introduce storage_client in DistributedRuntime (#3507) · 7a7d397c
  Graham King authored Oct 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7a7d397c
- docs: move all md files from components to docs (#3440) · 0a2a820b
  Anant Sharma authored Oct 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  0a2a820b
- build: Adding `--model` argument to container launch message (#3536) · b640f283
  KrishnanPrash authored Oct 09, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b640f283
- fix: Send last token batch when finish_reason is set (#3531) · 111c6814
  Ryan McCormick authored Oct 09, 2025
  
  111c6814
09 Oct, 2025 15 commits
- refactor: remove sglang config and util files from components (#3467) · 03bdced9
  Anant Sharma authored Oct 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  03bdced9
- feat: sglang prefill router + bump to `0.5.3` (#3498) · 51f65757
  ishandhanani authored Oct 09, 2025
  
  51f65757
- fix: profilier bug fixes and doc improvements (#3530) · 179f993a
  Alec authored Oct 09, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  179f993a
- fix: setup planner serviceaccount in cluster-wide deployment (#3520) · bfbcae7a
  Julien Mancuso authored Oct 09, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  bfbcae7a
- refactor: remove vllm prefill worker background loop check (#3529) · 07a64744
  Yan Ru Pei authored Oct 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  07a64744
- feat: document multinode operator behavior (#3506) · 9414e3be
  Julien Mancuso authored Oct 09, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9414e3be
- feat: allow shutdown of orphaned kv consumers on Router startup (#3516) · 0844f8ee
  Yan Ru Pei authored Oct 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0844f8ee
- docs: add vLLM KVBM 2P2D example due to a special ENV VAR to note (#3526) · 44012a24
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  44012a24
- chore: add sample KVBM related k8s deployment manifests (#3523) · 5f7c1f7e
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  5f7c1f7e
- chore: Remove clear_namespace script (#3519) · e9a71009
  Graham King authored Oct 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e9a71009
- chore: Remove deprecated components/metrics and references (#3475) · be001a58
  Keiven C authored Oct 09, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  be001a58
- fix: use rolling hasher for sin_synth.py (#3514) · f712653e
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  f712653e
- fix: update ECS doc (#3500) · db192a35
  kYLe authored Oct 09, 2025
```
Signed-off-by: Kyle H <kylhuang@nvidia.com>
```
  db192a35
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
- feat: changing SIGKILL to SIGINT for graceful shutdown (#3513) · cdfd70f0
  Tzu-Ling Kan authored Oct 08, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  cdfd70f0
08 Oct, 2025 9 commits
- fix: remove _version import in config_dump (#3502) · 9b5bab72
  William Arnold authored Oct 08, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  9b5bab72
- feat: Add OpenAPI routes to serve HTTP server API documentation (#3480) · ef04a086
  Ryan McCormick authored Oct 08, 2025
  
  ef04a086
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- chore: Remove llama.cpp engine (#3499) · 0aa0768f
  Graham King authored Oct 08, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0aa0768f
- fix: update dynamo namespace env var usage (#3477) · 552146f2
  Biswa Panda authored Oct 08, 2025
  
  552146f2
- ci: disable gitlab sdk pipeline (#3494) · 466b1993
  Anant Sharma authored Oct 08, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  466b1993
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
- feat: DIS-678 kvbm modularity: standalone metrics endpoint (#3433) · cf83794a
  Richard Huo authored Oct 08, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  cf83794a
- fix: frontend component handles graceful shutdown (#3481) · 2d59861e
  Thomas Montfort authored Oct 08, 2025
  
  2d59861e