Commits · 9b8b998803fac0baabdd0d7c081540fec733fa13 · OpenDAS / dynamo

22 Nov, 2025 1 commit

chore: upgrade trtllm 1.2.0rc2 (#4405) · 9b8b9988

Dmitry Tokarev authored Nov 21, 2025


Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Kyle McGill <kmcgill@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>

9b8b9988

21 Nov, 2025 3 commits

chore: split frontend + runtime launch message to accurately represent container purpose (#4537) · f2769d88
Tushar Sharma authored Nov 21, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
f2769d88

ci: Testing b64 multimodal support with real image (#4280) · e7544f19

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

e7544f19

test: parallel mocker tests in CI (#4493) · 6e241236
Yan Ru Pei authored Nov 20, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
6e241236

19 Nov, 2025 2 commits
- chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281) · 0b8b7ffb
  Kyle McGill authored Nov 19, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  0b8b7ffb
- chore: Unpinned accelerate version (#4458) · d01b6d2d
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: Kris Hung <krish@nvidia.com>
```
  d01b6d2d
18 Nov, 2025 4 commits
- chore: update aiperf version (#4438) · 81491b39
  Tushar Sharma authored Nov 18, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  81491b39
- fix: TENSORRTLLM_PIP_WHEEL_DIR has reasonable default set when building and... · 771d8c02
  Kyle McGill authored Nov 18, 2025
```
fix: TENSORRTLLM_PIP_WHEEL_DIR has reasonable default set when building and installing TRTLLM from source (#4414)
```
  771d8c02
- fix: point to new sglang container and rm references to old (#4383) · 48c340f4
  ishandhanani authored Nov 17, 2025
  
  48c340f4
- fix: Fix cublas and cublasLt symlinks in vLLM runtime container (#4421) · 1a27649c
  jthomson04 authored Nov 17, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1a27649c
17 Nov, 2025 1 commit
- fix: Install jq in trtllm runtime container (#4398) · 54addb54
  Tushar Sharma authored Nov 17, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  54addb54
14 Nov, 2025 4 commits
- fix: use release build for ucx (#4345) · 2405bac7
  Anant Sharma authored Nov 14, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  2405bac7
- refactor: migrate kvbm python bindings to the python directory (#4318) · 5a5bc51e
  Ryan Olson authored Nov 14, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  5a5bc51e
- docs: update readme for non root user (#4300) · 5d1ff687
  Anant Sharma authored Nov 14, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  5d1ff687
- fix: add kvbm arg in trtllm runtime image build (#4337) · d6cda975
  Anant Sharma authored Nov 14, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  d6cda975
13 Nov, 2025 1 commit

fix: TRTLLM build from source not repsecting the wheel installation directory (#4241) · 02763376

Kyle McGill authored Nov 13, 2025


Signed-off-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>

02763376

12 Nov, 2025 1 commit
- build: OPS-810: add dynamo frontend image w/EPP support (#4150) · a38319e6
  Tushar Sharma authored Nov 12, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  a38319e6
11 Nov, 2025 2 commits
- feat: sglang update to `0.5.3.post4` (#4227) · d9b674b8
  ishandhanani authored Nov 11, 2025
  
  d9b674b8
- fix: use latest tag across all branches for version detection (#4229) · bba41321
  Keiven C authored Nov 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bba41321
10 Nov, 2025 3 commits

feat: DynamoPlanner profiler to use hf_id for AIConfigurator 0.4.0 (#4167) · 43986372

Jason Zhou authored Nov 10, 2025


Signed-off-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
Co-authored-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>

43986372

build: add non root user for dynamo backend runtime containers (#3935) · 6f708832
Anant Sharma authored Nov 10, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
6f708832

feat: support TEP/DEP for DSR1 in SGLang MoE Planner (#4203) · 5e4a339a

Hongkuan Zhou authored Nov 10, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

5e4a339a

07 Nov, 2025 1 commit

feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) · 6bccf099

Keiven C authored Nov 07, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6bccf099

05 Nov, 2025 1 commit
- chore: bump ai-configurator version in container to make gradio install optional (#4106) · 83a3fe4e
  Tushar Sharma authored Nov 04, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  83a3fe4e
03 Nov, 2025 1 commit
- chore: bump fastapi version to 0.120.1 (#4002) · 92909c8a
  Tushar Sharma authored Nov 03, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  92909c8a
31 Oct, 2025 2 commits
- chore: KVBM pip wheel (#3826) · 6afa679c
  Richard Huo authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  6afa679c
- refactor: move backend deploy, launch and slurm files from components to examples (#3849) · 8bd37c96
  Anant Sharma authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8bd37c96
30 Oct, 2025 4 commits
- chore: Revert "bump sglang version for 0.6.1 dynamo release (#3911)" (#3994) · 5f9d2025
  Tushar Sharma authored Oct 30, 2025
  
  5f9d2025
- chore: override docker build defaults for vllm + arm64 (#3980) · 15663b85
  Karen Chung authored Oct 30, 2025
  
  15663b85
- ci: Use nvcr.io image for sglang base container (#3996) · 7ca658f4
  Dillon Cullinan authored Oct 30, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  7ca658f4
- chore: bump nixl verison to 0.7.0 (#3936) · 1da9d70a
  Tushar Sharma authored Oct 30, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  1da9d70a
29 Oct, 2025 2 commits
- chore: bump sglang version for 0.6.1 dynamo release (#3911) · 666e4aa7
  Tushar Sharma authored Oct 29, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  666e4aa7
- fix: Refactored build.sh to allow users to install their local trtllm wheel (#3769) · 3077e1ec
  Kyle McGill authored Oct 29, 2025
```
Signed-off-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  3077e1ec
28 Oct, 2025 2 commits
- docs: update container paths and interactive mode usage in READMEs (#3927) · 12083e9c
  Keiven C authored Oct 28, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  12083e9c
- fix: create virtualenv in Dockerfile.sglang dev stage for maturin dev (#3931) · 2e241eb5
  Keiven C authored Oct 28, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  2e241eb5
27 Oct, 2025 2 commits

build: OPS-1140: Refactor sglang dockerfile to support wideep (#3792) · 7c74764b

Tushar Sharma authored Oct 27, 2025


Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Tzu-Ling Kan <tzulingk@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Rohan Varma <rohanv@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

7c74764b

refactor: Dev Container (devcontainer) to standardize paths to /workspace (for... · 6739154d

Keiven C authored Oct 27, 2025


refactor: Dev Container (devcontainer) to standardize paths to /workspace (for pytest compatibility) (#3870)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

6739154d

24 Oct, 2025 1 commit
- refactor: move engine configs out of components directory (#3772) · 8354d325
  Anant Sharma authored Oct 24, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
```
  8354d325
23 Oct, 2025 1 commit
- refactor: remove unused build args and update comments (#3688) · 3df1e8c2
  Keiven C authored Oct 23, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3df1e8c2
22 Oct, 2025 1 commit
- fix: Load deployment card from ModelExpress for EPP (#3793) · c8adbe6f
  atchernych authored Oct 22, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c8adbe6f