Commits · b2f7f220c63197aedc795a7805513eeea2ff12a4 · OpenDAS / dynamo · GitLab

15 Apr, 2026 3 commits
- test(router): add single-worker mocker soak test (#8234) · 44cfbb68
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  44cfbb68
- feat: add TRT-LLM sleep/wake integration with GMS (#7575) · d96a2cf1
  hhzhang16 authored Apr 15, 2026
```
Co-authored-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  d96a2cf1
- ci: Move TRTLLM Fault Tolerance tests from post-merge back to nightly (#8210) · 71af9675
  Dmitry Tokarev authored Apr 15, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  71af9675
14 Apr, 2026 10 commits
- feat: add unified backend architecture with DynamoBackend (#8003) · da40db40
  Tanmay Verma authored Apr 14, 2026
```
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
```
  da40db40
- feat: remove enable_nats usage (#7265) · af0ff07c
  Biswa Panda authored Apr 14, 2026
  
  af0ff07c
- feat(lora): add LoRA support for SGLang (#4769) · f9839161
  Biswa Panda authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f9839161
- feat: lmcache on CUDA 13 and ARM (#7534) · 21b44473
  Dmitry Tokarev authored Apr 14, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  21b44473
- fix: Reject local file inputs in ImageLoader (#8158) · 56f02422
  Graham King authored Apr 14, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  56f02422
- feat: add DGDR test suite (#7343) · 597b7249
  Ashna Mehrotra authored Apr 14, 2026
```
Signed-off-by: ashnamehrotra <ashnamehrotra@gmail.com>
```
  597b7249
- chore: remove deprecated examples/multimodal directory (#8141) · 617d55c0
  Ryan McCormick authored Apr 14, 2026
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  617d55c0
- fix(tests): re-enable vLLM LoRA tests and fix gpu_1 test flakiness (#8094) · 326a702d
  Keiven C authored Apr 14, 2026
```
Signed-off-by: Keiven Chang <keivenc@nvidia.com>
```
  326a702d
- test: reorganize and prune GPU Memory Service tests (#7828) · b78ec99a
  Schwinn Saereesitthipitak authored Apr 14, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  b78ec99a
- feat(gms): exported GMS handles on allocation (#8108) · 49feb284
  Schwinn Saereesitthipitak authored Apr 13, 2026
  
  49feb284
13 Apr, 2026 7 commits
- fix(ci): move test_multimodal_b64 to gpu_1 and force tool calls in... · 6bfc6d1f
  knarangN authored Apr 13, 2026
```
fix(ci): move test_multimodal_b64 to gpu_1 and force tool calls in aggregated_toolcalling (DYN-2662) (#8126)
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  6bfc6d1f
- fix: disagg_same_gpu - profiling markers, GPU pinning, and memory args (#7996) · e3e728a8
  Keiven C authored Apr 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  e3e728a8
- fix(test): unskip test_smoke by switching to trtllm attention backend (DYN-2607) (#8104) · 9bc6d98d
  Yuewei Na authored Apr 13, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  9bc6d98d
- feat: add KV cache transfer estimated latency metric for disaggregated serving (#7590) · 1ebe7060
  Jonathan Tong authored Apr 13, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  1ebe7060
- chore: upgrade sglang dependency from 0.5.9 to 0.5.10.post1 (#7997) · e48de6aa
  Krishnan Prashanth authored Apr 13, 2026
```
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e48de6aa
- fix(kvbm): handle typed KvCacheConnectorConfig in consolidator check (#8117) · edce7d3d
  Alec authored Apr 13, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
```
  edce7d3d
- chore(multimodal): Add XPU aggregated video vLLM launch example (#7855) · 934b49ef
  Yi Yao authored Apr 13, 2026
```
Signed-off-by: Yi Yao <yi.a.yao@intel.com>
```
  934b49ef
11 Apr, 2026 1 commit
- feat: Request Migration disable on max seq len exceeded (#8020) · f6976e7f
  Jacky authored Apr 10, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  f6976e7f
10 Apr, 2026 3 commits
- fix(ci): multimodal vLLM nightly — predownload, audio KV, 7B toolcalling (DYN-2569) (#7964) · eb772381
  knarangN authored Apr 10, 2026
```
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  eb772381
- test: skip persistent nightly CI failures and provide associated tickets (#8006) · bcd0fc06
  Tushar Sharma authored Apr 10, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  bcd0fc06
- refactor: inline env var lookups to avoid noisy tracebacks (#8045) · 386aa114
  Dmitry Tokarev authored Apr 10, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  386aa114
09 Apr, 2026 3 commits
- refactor: simplify GPU Memory Service integrations and module boundaries (#7875) · 39a6a240
  Schwinn Saereesitthipitak authored Apr 09, 2026
  
  39a6a240
- feat(vllm): add audio_url loading to multimodal handler (#7955) · 8fd1b847
  Neal Vaidya authored Apr 09, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  8fd1b847
- feat(test): add generalized multimodal model coverage framework (#7975) · f45a6985
  Qi Wang authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  f45a6985
08 Apr, 2026 5 commits
- feat: vllm omni disagg (#7409) · 1c199f88
  Ayush Agarwal authored Apr 08, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  1c199f88
- feat(kvbm): add MLA support for DeepSeek-V2 and extend determinism tests (#7786) · ba34f131
  Olga Andreeva authored Apr 08, 2026
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: wz1qqx <ziqi.wang@novita.ai>
```
  ba34f131
- feat(vllm): compute Qwen VL grid_thw from PIL images for P/D disagg (#7885) · d517fb80
  Qi Wang authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d517fb80
- test(router): cover round-robin unset dp-rank flow (#7991) · c09abf7d
  Yan Ru Pei authored Apr 08, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  c09abf7d
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
07 Apr, 2026 7 commits
- refactor: split build_gpu_mem_args into engine-specific functions (#7916) · 4cdc49c2
  Keiven C authored Apr 07, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  4cdc49c2
- feat(sglang): add video input support for aggregated serving (#7941) · b1c18bb1
  Zhuangcheng Gu authored Apr 07, 2026
```
Signed-off-by: Chokoyo <40918450+Chokoyo@users.noreply.github.com>
```
  b1c18bb1
- test: e2e JSONL log verification for request tracing (#7817) · 73f8557a
  Neelay Shah authored Apr 07, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  73f8557a
- feat: add Allure test dashboard on GitHub Pages (#6903) · e24b25f8
  Dmitry Tokarev authored Apr 07, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  e24b25f8
- fix: broken vLLM nightly gpu_2 test and vLLM API compatibility errors (#7865) · 3ad7b7c8
  Keiven C authored Apr 07, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3ad7b7c8
- feat: Request Rejection Frontend metrics (#7644) · 3205e7db
  Jacky authored Apr 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  3205e7db
- feat: add a few TRT-LLM example support for GPU-parallel test execution (#7880) · ad2205eb
  Keiven C authored Apr 06, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  ad2205eb
06 Apr, 2026 1 commit
- perf(multimodal): strip inline base64 from TCP transport in frontend decoding (#7895) · 6b8545fc
  Qi Wang authored Apr 06, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6b8545fc