Commits · 6a0e67ed781497289d2f12c156f723ebf874b8aa · OpenDAS / dynamo · GitLab

26 Nov, 2025 16 commits
- feat: add LoRA common APIs and implementation for lora management (#4464) · 6a0e67ed
  Biswa Panda authored Nov 26, 2025
  
  6a0e67ed
- test: Add KV transfer cancellation test on TRT-LLM (#4547) · bbaab9f7
  Jacky authored Nov 26, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  bbaab9f7
- feat(fault-injection): Add high-level CUDA fault injection helper (#4041) · 26eb14cd
  nv-oviya authored Nov 26, 2025
  
  26eb14cd
- feat(fault-injection): Add core testing helper utilities (#4040) · 011a200a
  nv-oviya authored Nov 26, 2025
  
  011a200a
- feat(fault-injection): Add CUDA fault injection library foundation (#4038) · 78934278
  nv-oviya authored Nov 26, 2025
```
Signed-off-by: nv-oviya <oseeniraj@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  78934278
- docs: remove build container instructions from trtllm multimodal example (#4624) · 2e5e68b4
  dagil-nvidia authored Nov 26, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
```
  2e5e68b4
- fix: Remove the hard-coded version from installation path (#4564) · 953f5a14
  Tanmay Verma authored Nov 26, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  953f5a14
- docs: use default dynamo queue in KAI-Scheduler example (#4625) · a5e1335c
  dagil-nvidia authored Nov 26, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  a5e1335c
- docs: Fix the documentation for NIXL kv cache transfer backend (#4611) · 6cd6033c
  Tanmay Verma authored Nov 26, 2025
  
  6cd6033c
- chore: pin package versions in container requirements files (#4571) · 30aba52c
  Keiven C authored Nov 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  30aba52c
- chore(container): clean up Dockerfile.{sglang,trtllm,vllm} and build.sh (#4569) · f33fdd52
  Keiven C authored Nov 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f33fdd52
- feat: add trtllm env variables + gpu part numbers to config dump (#3912) · dfbcdbe0
  William Arnold authored Nov 25, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  dfbcdbe0
- test: Increase Cancellation Tests sequence and long prompt length (#4608) · 21c4739b
  Jacky authored Nov 25, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  21c4739b
- feat: support MQA + MoE (Qwen3 MoE) TEP/DEP in Planner Profiler (#4612) · 5652d670
  Hongkuan Zhou authored Nov 25, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  5652d670
- chore: update attributions (#4606) · 81ad38ef
  Harrison Saturley-Hall authored Nov 25, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  81ad38ef
- fix: inject TRTLLM_USE_UCX_KVCACHE env var in mpirun (#4609) · a5049f0f
  Rohan Varma authored Nov 25, 2025
  
  a5049f0f
25 Nov, 2025 21 commits
- refactor(storage): Remove the stuttering from key_value_store. (#4604) · fcb91e4b
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fcb91e4b
- chore: make loading planner profile data one-stage for mockers (#4590) · 7a384793
  Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7a384793
- chore: make router use the discovery pattern instead of manual kv watch (#4597) · 9c5018e5
  Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9c5018e5
- docs: remove frontend image from support matrix (#4589) · 445b4bd9
  dagil-nvidia authored Nov 25, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  445b4bd9
- fix: update ai-dynamo[vllm] version and pin transformers (#4592) · ef0a4721
  dagil-nvidia authored Nov 25, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  ef0a4721
- chore: update pvc name for trtllm dsr1 recipe (#4595) · 6e9782ba
  Hongkuan Zhou authored Nov 25, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  6e9782ba
- feat: Enable intel gaudi on dynamo (#4209) · d0e3b7b7
  Sihan Chen authored Nov 26, 2025
```
Signed-off-by: Spycsh <sihan.chen@intel.com>
```
  d0e3b7b7
- chore(runtime): Make nats_client private, refactor NATS stats scraping (#4591) · 17dcffe8
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  17dcffe8
- fix: Fix vllm MM aggregated mode Corner Case (#4583) · c90e3dff
  Indrajit Bhosale authored Nov 25, 2025
  
  c90e3dff
- feat: decoded media via NIXL (#3988) · 0a065918
  milesial authored Nov 25, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  0a065918
- fix: dsr1 recipe download pvc name (#4566) · b5db4e75
  Hongkuan Zhou authored Nov 25, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  b5db4e75
- refactor(llm): Rename EngineConfig::Static to InProcess (#4585) · 0fc5273c
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0fc5273c
- feat: allow dynamic port in scripts in preparation for parallel testing (part 1) (#4546) · a77558d4
  Keiven C authored Nov 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a77558d4
- fix: prevent cluster-wide operator from reconciling DGDR/DynamoModel in... · 0a8b917e
  Julien Mancuso authored Nov 25, 2025
```
fix: prevent cluster-wide operator from reconciling DGDR/DynamoModel in namespaces with namespace-restricted operator (#4574)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  0a8b917e
- docs: update TensorRT-LLM commit for NIXL to v1.2.0rc2 (#4582) · 93c81420
  dagil-nvidia authored Nov 25, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  93c81420
- chore(runtime): Tidy up component paths (#4560) · 51c1b9f1
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  51c1b9f1
- fix: Dockerfile.trtllm - install triton when building from source on arm (#4579) · 4babb33c
  Dmitry Tokarev authored Nov 25, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  4babb33c
- fix: expose prefill worker id in disagg (#4563) · 57c701fb
  Yan Ru Pei authored Nov 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  57c701fb
- feat: Add security flag to MM flow in vllm (#4556) · 550bf98c
  Indrajit Bhosale authored Nov 24, 2025
```
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  550bf98c
- ci: Pin transformers version to 4.57.1 (#4561) · ef8cf365
  KrishnanPrash authored Nov 24, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  ef8cf365
- fix: Increase the failure threshold for k8s dsr1 trtllm wideep deploy.yaml (#4557) · d6aa4a0b
  Tanmay Verma authored Nov 24, 2025
  
  d6aa4a0b
24 Nov, 2025 2 commits
- docs: update support matrix for Dynamo 0.7.0 (#4550) · 25fd32ab
  dagil-nvidia authored Nov 24, 2025
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  25fd32ab
- fix(dynamo-run): Run without etcd/nats, HTTP port to 8000 (#4555) · e75bcf67
  Graham King authored Nov 24, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e75bcf67
23 Nov, 2025 1 commit
- feat: Better cublas support in vLLM container. (#4514) · f0ca16f0
  jthomson04 authored Nov 23, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  f0ca16f0