Commits · 8642c4bd7ccffbd5d37386ba5694e44953abcf25 · OpenDAS / dynamo · GitLab

22 Oct, 2025 10 commits
- fix: Add jq to sglang wideeep dockerfile (#3820) · 8642c4bd
  Tushar Sharma authored Oct 22, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  8642c4bd
- test: add backend-specific metrics validation for E2E tests (part 1/3, vLLM only) (#3804) · bdef0ec5
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bdef0ec5
- feat: add TensorRT-LLM Prometheus metrics support with prefixing + filtering (#3676) · f93b619a
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f93b619a
- fix: disagg dp attention needs host 0.0.0.0 (#3809) · 79ad7f36
  ishandhanani authored Oct 22, 2025
  
  79ad7f36
- fix: correct prefill/decode block defaults when no overlaps (#3811) · db8e52f2
  Yan Ru Pei authored Oct 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  db8e52f2
- fix: gb200 nixl instructions and max cuda graph bs on h100 instructions (#3807) · 87ea346d
  ishandhanani authored Oct 21, 2025
  
  87ea346d
- fix: Migrate to new implementation that using parse_tool_calls_harmony_complete (#3685) · 656b4c44
  zhongdaor-nv authored Oct 21, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  656b4c44
- fix: enhance gRPC frontend to return output in raw content field for Triton... · d68e4b8a
  GuanLuo authored Oct 22, 2025
```
fix: enhance gRPC frontend to return output in raw content field for Triton client compatibility (#3600)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  d68e4b8a
- fix: aiperf retry fix (#3678) · 03bd92de
  Tzu-Ling Kan authored Oct 21, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  03bd92de
- feat: python gil release for radix tree + dump_tree_as_events in python (#3748) · 681951d4
  Michael Feil authored Oct 21, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  681951d4
21 Oct, 2025 21 commits
- feat: Detect if cluster has Grove. Use Grove if available. (#3789) · e6fc0e29
  Tzu-Ling Kan authored Oct 21, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  e6fc0e29
- test: add error bubbling from profiling and more error handling tests (#3785) · ad0648f4
  hhzhang16 authored Oct 21, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  ad0648f4
- feat: remove deploy/utils rbac (#3771) · eb73c2b0
  hhzhang16 authored Oct 21, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  eb73c2b0
- feat: vllm moe k8 FT tests (#3672) · d81a00ef
  Tzu-Ling Kan authored Oct 21, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d81a00ef
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
- ci: Use proxy for dockerhub images (#3778) · cd5e7e33
  Dillon Cullinan authored Oct 21, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  cd5e7e33
- docs: Add cancellation docs for vLLM, TRT-LLM and SGLang backends (#3783) · 22d22777
  Jacky authored Oct 21, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  22d22777
- docs: Add version 0.6.0 to versions1.json (#3795) · 8ad3b9a2
  Kristen Kelleher authored Oct 21, 2025
```
Signed-off-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  8ad3b9a2
- build: Add prometheus_client dependency for pip install without container (#3794) · 70e32f84
  Ryan McCormick authored Oct 21, 2025
  
  70e32f84
- fix: revert placement of logging init if otel exports is disabled (#3797) · 8a04d7b2
  mohammedabdulwahhab authored Oct 21, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  8a04d7b2
- docs: Add AIConfigurator and disagg example for Dynamo vLLM (#3183) · 69fffdba
  kYLe authored Oct 21, 2025
```
Signed-off-by: Kyle H <kylhuang@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Signed-off-by: kYLe <kylhuang@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
```
  69fffdba
- fix: update crate lib/runtime README to one that exists (#3786) · 237e978f
  Harrison Saturley-Hall authored Oct 21, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  237e978f
- ci: Add --prerelease=allow flag to sglang installation (#3779) · 6a2dedd2
  Tushar Sharma authored Oct 21, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  6a2dedd2
- fix: MINOR Disable deploy tests to fix docker rate limits (#3776) · 831dc82a
  Dillon Cullinan authored Oct 21, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  831dc82a
- chore: rm --enable-kvbm in docker build since KVBM is in by default (#3775) · b7c335a4
  Ziqi Fan authored Oct 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  b7c335a4
- fix: Update Grove dependency version to v0.1.0-alpha.3 (#3744) · 0c87b00f
  dagil-nvidia authored Oct 21, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Rohan Varma <rohanv@nvidia.com>
```
  0c87b00f
- feat: enable KVBM GPU offload to Disk bypassing CPU (#3510) · d5840cda
  Ziqi Fan authored Oct 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  d5840cda
- refactor(runtime): Replace std::sync::Mutex with parking_lot::Mutex (#3740) · 9ae98ed7
  Graham King authored Oct 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9ae98ed7
- fix: fix the ooms in gb200 default instructions (#3768) · 2a24e4aa
  ishandhanani authored Oct 20, 2025
  
  2a24e4aa
- fix: Fix fault tolerance metrics calculation bug (#3674) · 9a723734
  Tzu-Ling Kan authored Oct 20, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  9a723734
- chore: tool calling -- sglang e2e tests (#3650) · 43329cd6
  Elyas Mehtabuddin authored Oct 20, 2025
  
  43329cd6
20 Oct, 2025 8 commits
- fix: block_manager/disk - fix `fallocate` failure on some file systems (#2680) · 6ace46ce
  Dan Aloni authored Oct 21, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
```
  6ace46ce
- fix: fixing the NUMA sensitivity problem in KVBM for TP=1 (#3700) · 67d27bcc
  Olga Andreeva authored Oct 20, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  67d27bcc
- chore: Replace ServiceConfigBuilder with add_stats_service (#3736) · f6ed01b1
  Graham King authored Oct 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f6ed01b1
- fix: update gb200 instructions and add a temp container tag (#3741) · a7fed329
  ishandhanani authored Oct 20, 2025
  
  a7fed329
- feat: python package build with abi (cross py3.10+) (#3571) · af7b73c0
  Michael Feil authored Oct 20, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  af7b73c0
- fix: update aiperf commands for trace dataset (#3737) · abbbc187
  Hongkuan Zhou authored Oct 20, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  abbbc187
- docs: Add KV Smart Router A/B Benchmarking Guide (#3696) · a665886a
  Ben Hamm authored Oct 20, 2025
```
Signed-off-by: Ben Hamm <bhamm@nvidia.com>
Co-authored-by: Ben Hamm <bhamm@bhamm-mlt.client.nvidia.com>
Co-authored-by: Ben Hamm <bhamm@nvidia.com>
```
  a665886a
- fix: limit the number of build jobs on sglang-wideep (#3723) · 68444751
  Harrison Saturley-Hall authored Oct 20, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  68444751
18 Oct, 2025 1 commit
- feat: add prefill workers to discovery (#3709) · 4b7a806c
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4b7a806c