Commits · 4b3cd459dffb08fd462cab9e4df34ca39f4aa7f9 · OpenDAS / dynamo

21 Apr, 2026 3 commits

fix: replace torch.load with safetensors and enable Rust frontend media... · f923777e

Indrajit Bhosale authored Apr 21, 2026

fix: replace torch.load with safetensors and enable Rust frontend media decoding for TRT-LLM multimodal (#8295)
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

f923777e

test(serve): skip mm_agg_qwen2-audio-7b vLLM deployment on post-merge (#8411) · d795e1a4
Dmitry Tokarev authored Apr 21, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
```
d795e1a4
test(sglang): add pre_merge diffusion CI smoke tests for T2I and T2V (#8409) · 8679faa3
Krishnan Prashanth authored Apr 21, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
8679faa3

20 Apr, 2026 1 commit

fix: llava EPD deployment. add llava coverage (#8330) · e71f1d2b

GuanLuo authored Apr 20, 2026

Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>

e71f1d2b

14 Apr, 2026 6 commits
- feat: add unified backend architecture with DynamoBackend (#8003) · da40db40
  Tanmay Verma authored Apr 14, 2026
```
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
```
  da40db40
- feat(lora): add LoRA support for SGLang (#4769) · f9839161
  Biswa Panda authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f9839161
- feat: lmcache on CUDA 13 and ARM (#7534) · 21b44473
  Dmitry Tokarev authored Apr 14, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  21b44473
- fix: Reject local file inputs in ImageLoader (#8158) · 56f02422
  Graham King authored Apr 14, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  56f02422
- chore: remove deprecated examples/multimodal directory (#8141) · 617d55c0
  Ryan McCormick authored Apr 14, 2026
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  617d55c0
- fix(tests): re-enable vLLM LoRA tests and fix gpu_1 test flakiness (#8094) · 326a702d
  Keiven C authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenc@nvidia.com>
```
  326a702d
13 Apr, 2026 3 commits
- fix(ci): move test_multimodal_b64 to gpu_1 and force tool calls in... · 6bfc6d1f
  knarangN authored Apr 13, 2026
```
fix(ci): move test_multimodal_b64 to gpu_1 and force tool calls in aggregated_toolcalling (DYN-2662) (#8126)
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  6bfc6d1f
- fix: disagg_same_gpu - profiling markers, GPU pinning, and memory args (#7996) · e3e728a8
  Keiven C authored Apr 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  e3e728a8
- chore(multimodal): Add XPU aggregated video vLLM launch example (#7855) · 934b49ef
  Yi Yao authored Apr 13, 2026
```
Signed-off-by: Yi Yao <yi.a.yao@intel.com>
```
  934b49ef
10 Apr, 2026 2 commits
- fix(ci): multimodal vLLM nightly — predownload, audio KV, 7B toolcalling (DYN-2569) (#7964) · eb772381
  knarangN authored Apr 10, 2026
```
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  eb772381
- test: skip persistent nightly CI failures and provide associated tickets (#8006) · bcd0fc06
  Tushar Sharma authored Apr 10, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  bcd0fc06
09 Apr, 2026 2 commits
- feat(vllm): add audio_url loading to multimodal handler (#7955) · 8fd1b847
  Neal Vaidya authored Apr 09, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  8fd1b847
- feat(test): add generalized multimodal model coverage framework (#7975) · f45a6985
  Qi Wang authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  f45a6985
08 Apr, 2026 2 commits
- feat: vllm omni disagg (#7409) · 1c199f88
  Ayush Agarwal authored Apr 08, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1c199f88
- feat(vllm): compute Qwen VL grid_thw from PIL images for P/D disagg (#7885) · d517fb80
  Qi Wang authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d517fb80
07 Apr, 2026 4 commits
- refactor: split build_gpu_mem_args into engine-specific functions (#7916) · 4cdc49c2
  Keiven C authored Apr 07, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  4cdc49c2
- feat(sglang): add video input support for aggregated serving (#7941) · b1c18bb1
  Zhuangcheng Gu authored Apr 07, 2026
```
Signed-off-by: Chokoyo <40918450+Chokoyo@users.noreply.github.com>
```
  b1c18bb1
- fix: broken vLLM nightly gpu_2 test and vLLM API compatibility errors (#7865) · 3ad7b7c8
  Keiven C authored Apr 07, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3ad7b7c8
- feat: add a few TRT-LLM example support for GPU-parallel test execution (#7880) · ad2205eb
  Keiven C authored Apr 06, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  ad2205eb
06 Apr, 2026 1 commit
- perf(multimodal): strip inline base64 from TCP transport in frontend decoding (#7895) · 6b8545fc
  Qi Wang authored Apr 06, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6b8545fc
03 Apr, 2026 1 commit
- chore(multimodal): Cleanup multimodal docs and consolidate launch scripts (#7845) · dacb2980
  Ryan McCormick authored Apr 03, 2026
  
  dacb2980
02 Apr, 2026 3 commits
- refactor(vLLM): Move video support from example to backend (#7663) · 4791aaaa
  Ryan McCormick authored Apr 02, 2026
  
  4791aaaa
- feat: GPU-parallel test runner with VRAM-aware scheduling (#7560) · 6dc85fbc
  Keiven C authored Apr 02, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6dc85fbc
- feat: add examples and unit tests for vLLM aggregated serving on XPU (#7146) · dd7ceb4a
  Yi Yao authored Apr 02, 2026
```
Signed-off-by: Yi Yao <yi.a.yao@intel.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  dd7ceb4a
01 Apr, 2026 1 commit
- test: Add ci coverage for trtllm multimodal raw embeddings (#7540) · c84c0934
  Indrajit Bhosale authored Apr 01, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c84c0934
31 Mar, 2026 2 commits
- feat: add initial audio/TTS pipeline support for vLLM-omni backend (#7495) · cbbde3d0
  Zhongdongming Dai authored Mar 31, 2026
```
Signed-off-by: Zhongdongming Dai <zhongdongmin@nvidia.com>
```
  cbbde3d0
- fix: align video diffusion pipeline with TRT-LLM 1.3.0rc9 API changes (#7529) · 10fb23d2
  Indrajit Bhosale authored Mar 31, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  10fb23d2
20 Mar, 2026 2 commits
- feat: GPU VRAM profiler + profiled test markers for 1 GPU SGLang (part 3) (#7508) · 6ed8ba0a
  Keiven C authored Mar 20, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6ed8ba0a
- feat: [vLLM] add remote embedding loader to prefill/decode worker. Port E/P/D usage (#7507) · 4d302ab6
  GuanLuo authored Mar 19, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  4d302ab6
19 Mar, 2026 4 commits
- fix: unskip multimodal_disagg_qwen EPD test (#7523) · fa92958a
  KrishnanPrash authored Mar 19, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  fa92958a
- fix: increase `/dev/shm` for CI pytest containers to fix NIXL UCX segfault (#7515) · 4fc2b5e8
  KrishnanPrash authored Mar 19, 2026
  
  4fc2b5e8
- fix: restore serve test timeouts for slower CI GPUs (#7510) · 934b0669
  Keiven C authored Mar 19, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  934b0669
- feat: add NixlEmbeddingSender / NixlEmbeddingReceiver in sglang backend (#7153) · 70892fc1
  Wang, Yi authored Mar 19, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  70892fc1
18 Mar, 2026 2 commits

feat: GPU VRAM profiler via memory fraction injection + profiled test markers... · 0b20745e

Keiven C authored Mar 18, 2026


feat: GPU VRAM profiler via memory fraction injection + profiled test markers (part 2 - vLLM only) (#6719)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

0b20745e

chore: add vllm omni e2e tests (#7454) · f890199f
Ayush Agarwal authored Mar 18, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
f890199f

17 Mar, 2026 1 commit
- ci: add E/P/D multimodal CI coverage for SGLang (#7444) · d92d5c77
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  d92d5c77