Commits · 10bfb73a01273f86d07b55dd1a9a7e41c0ef08c1 · OpenDAS / dynamo

19 Sep, 2025 1 commit
- refactor: simplify Dockerfile.vllm, enable local-dev for all frameworks (#3099) · 10bfb73a
  Keiven C authored Sep 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  10bfb73a
09 Sep, 2025 2 commits
- chore: Update trtllm version to 1.1.0rc3 (#2930) · e8cb972e
  Indrajit Bhosale authored Sep 09, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  e8cb972e
- ci: Fix Dockerfile mount secrets (#2960) · be48b4cf
  Dillon Cullinan authored Sep 09, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  be48b4cf
08 Sep, 2025 2 commits
- build: OPS-597: restructure sglang to follow container strategy structure (#2803) · f0cea269
  Tushar Sharma authored Sep 08, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  f0cea269
- ci: OPS-724: Move to ARC runners (#2904) · 41dacce7
  Dillon Cullinan authored Sep 08, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  41dacce7
05 Sep, 2025 1 commit

revert: restore Dockerfile.vllm and build/run scripts to August 28 vers (#2892) · b6b3a767

Keiven C authored Sep 04, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

b6b3a767

03 Sep, 2025 2 commits

fix: dev target needs special permission, now VLLM version works for run.sh... · eb317cdf

Keiven C authored Sep 03, 2025

fix: dev target needs special permission, now VLLM version works for run.sh and Dev Container (#2822)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

eb317cdf

build: default to using dev instead of local-dev for vllm build (#2834) · e432ae4a
Tushar Sharma authored Sep 03, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
e432ae4a

02 Sep, 2025 1 commit
- build: enable kvbm in vllm container (#2763) · 316e8844
  Anant Sharma authored Sep 02, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  316e8844
29 Aug, 2025 1 commit
- chore: rm not needed kvbm Dockerfile (#2789) · b738e6a0
  Ziqi Fan authored Aug 29, 2025
  
  b738e6a0
28 Aug, 2025 1 commit
- ci: add support for vllm sanity testing on Github (#2526) · 82bae247
  Anant Sharma authored Aug 28, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  82bae247
22 Aug, 2025 1 commit
- fix: Update tensorrt_llm to 1.0.0rc6 (#2606) · 9ab37d94
  Tanmay Verma authored Aug 21, 2025
  
  9ab37d94
21 Aug, 2025 1 commit
- chore: Update UCX to 1.19.0 release (#2551) · d2d1a320
  Adit Ranadive authored Aug 21, 2025
```
Signed-off-by: Adit Ranadive <aranadive@nvidia.com>
```
  d2d1a320
19 Aug, 2025 2 commits

feat: kvbm + connector (#2258) · 07cfc3a1

Ryan Olson authored Aug 19, 2025


Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: John Thompson <jothomson@nvidia.com>
Co-authored-by: Richard Huo <rihuo@nvidia.com>
Co-authored-by: Zicheng Ma <zichengm@nvidia.com>

07cfc3a1

fix: add --enable-kvbm doc to build.sh help (#2530) · bf5862a1
Harrison Saturley-Hall authored Aug 19, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
bf5862a1

15 Aug, 2025 2 commits
- fix: remove kvmanager feature from python 3.12 ai-dynamo-runtime wheel (#2456) · ffae72b7
  Harrison Saturley-Hall authored Aug 15, 2025
  
  ffae72b7
- chore: Rename tensorrtllm framework to trtllm (#2435) · a3d624a7
  Tanmay Verma authored Aug 14, 2025
  
  a3d624a7
07 Aug, 2025 1 commit

build: introduce dynamo base container (#2222) · 10f4302d

Tushar Sharma authored Aug 07, 2025


Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

10f4302d

05 Aug, 2025 2 commits

docs: add GPT-OSS deployment guide (#2297) · 8964d0d5

Neal Vaidya authored Aug 05, 2025


Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: John Thomson (DLAlgo) <jothomson@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

8964d0d5

fix: Update the NIXL TRTLLM commit version to rc4 (#2284) · 30f33524
Tanmay Verma authored Aug 04, 2025

30f33524

31 Jul, 2025 2 commits
- chore: update nixl version to 0.4.1 (#2221) · 625578c3
  Anant Sharma authored Jul 31, 2025
  
  625578c3
- fix: Migrating trtllm examples from `1.0.0rc0` to `1.0.4rc4` (#2217) · f10aab3b
  KrishnanPrash authored Jul 31, 2025
  
  f10aab3b
25 Jul, 2025 1 commit

build: Add TensorRT-LLM to optional dependency and corresponding instructions (#2113) · 2cd96ec7

Tanmay Verma authored Jul 25, 2025


Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

2cd96ec7

18 Jul, 2025 1 commit
- chore: Move NIXL repo clone to Dockerfiles (#2009) · dc75cf18
  ptarasiewiczNV authored Jul 18, 2025
  
  dc75cf18
17 Jul, 2025 2 commits
- fix: Working Arm Build Dockerfile for Vllm_v1 (#1844) · 2b29a0aa
  zaristei authored Jul 17, 2025
  
  2b29a0aa
- refactor: replace vllm with vllm_v1 container (#1953) · 6d2be143
  Biswa Panda authored Jul 17, 2025
```
Co-authored-by: alec-flowers <aflowers@nvidia.com>
```
  6d2be143
15 Jul, 2025 1 commit
- fix: Fix TRT-LLM container build when using a custom pip wheel (#1825) · fc004d4d
  jthomson04 authored Jul 15, 2025
  
  fc004d4d
11 Jul, 2025 1 commit
- chore: update nixl to 0.4.0 release (#1860) (#1886) · d975761b
  Anant Sharma authored Jul 11, 2025
  
  d975761b
10 Jul, 2025 2 commits
- build: Revert "chore: update nixl to 0.4.0 release" (#1880) · 1704b126
  Tushar Sharma authored Jul 10, 2025
  
  1704b126
- chore: update nixl to 0.4.0 release (#1860) · 5fa4cdda
  Anant Sharma authored Jul 10, 2025
  
  5fa4cdda
03 Jul, 2025 1 commit
- chore: update nixl to latest 0.3.1 commit (#1762) · a9241b61
  Anant Sharma authored Jul 03, 2025
  
  a9241b61
26 Jun, 2025 1 commit
- feat: Add experimental WideEP + EPLB aggregated example for TRTLLM (#1652) · 5fe5a950
  Ryan McCormick authored Jun 27, 2025
  
  5fe5a950
24 Jun, 2025 1 commit
- feat: Using NIXL for KV cache transfer when using disaggregated serving in TRTLLM (#1591) · 0b7cdf55
  Tanmay Verma authored Jun 24, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0b7cdf55
18 Jun, 2025 1 commit
- chore: remove unneccssary line (#1582) · d2bec6f8
  tlipoca9 authored Jun 18, 2025
```
Signed-off-by: tlipoca9 <160737620+tlipoca9@users.noreply.github.com>
```
  d2bec6f8
16 Jun, 2025 1 commit
- build: DIS-148 use the tensorrt_llm public wheel from pypi by default in container build (#1525) · 47d05d7a
  richardhuo-nv authored Jun 16, 2025
  
  47d05d7a
14 Jun, 2025 1 commit

feat: add VllmDpWorker for DP setup (#1513) · 1906b702

GuanLuo authored Jun 13, 2025


Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>

1906b702

13 Jun, 2025 1 commit
- chore: update dynamo and nixl versions for 0.3.1 (#1517) · 99e67e60
  Anant Sharma authored Jun 13, 2025
  
  99e67e60
11 Jun, 2025 1 commit
- docs: MTP + TensorRT LLM + DS R1 disaggregated example (#1473) · 3363d8b6
  richardhuo-nv authored Jun 11, 2025
  
  3363d8b6
04 Jun, 2025 1 commit

feat: Update container with better EFA/RDMA support (#1333) · f7b3ccfc

Adit Ranadive authored Jun 04, 2025



Need to reinstall the rdma-core and libibverbs to use RDMA devices.
Also, docker container can be built using a recent version of UCX for
EFA support.
Signed-off-by: Adit Ranadive <aranadive@nvidia.com>

f7b3ccfc

31 May, 2025 1 commit
- fix: Update breaking change to enable_overlap_scheduler field from TRTLLM commit b4e5df0e (#1310) · 859944f4
  Ryan McCormick authored May 31, 2025
  
  859944f4