Commits · 0b20745edf3cb31f9294b5570a2f17ff2af3ea4d · OpenDAS / dynamo · GitLab

18 Mar, 2026 2 commits

feat: GPU VRAM profiler via memory fraction injection + profiled test markers... · 0b20745e

Keiven C authored Mar 18, 2026


feat: GPU VRAM profiler via memory fraction injection + profiled test markers (part 2 - vLLM only) (#6719)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

0b20745e

chore: add vllm omni e2e tests (#7454) · f890199f
Ayush Agarwal authored Mar 18, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
f890199f

17 Mar, 2026 3 commits
- ci: add E/P/D multimodal CI coverage for SGLang (#7444) · d92d5c77
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  d92d5c77
- ci(trtllm): fix aggregated_multimodal_router test (#7460) · 22fb3398
  KrishnanPrash authored Mar 17, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  22fb3398
- chore: unskip several multi-gpu tests and enable sglang multi-gpu tests (#7443) · 9681225a
  Dmitry Tokarev authored Mar 17, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9681225a
15 Mar, 2026 1 commit
- ci: enable multi-GPU tests in PR pipeline (#7355) · 4751f769
  Anant Sharma authored Mar 15, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  4751f769
13 Mar, 2026 1 commit
- ci: fit sglang multimodal EPD test on 1 GPU (#7046) · be2f1dc1
  KrishnanPrash authored Mar 13, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  be2f1dc1
12 Mar, 2026 1 commit
- feat(kv-router): add worker_type to router selection log (#7258) · dcbccbcd
  Yan Ru Pei authored Mar 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  dcbccbcd
11 Mar, 2026 3 commits
- test: pytests able to run locally now (#7219) · 4bd6299b
  Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4bd6299b
- fix: serialize disagg first_gen_log_probs int keys for Rust transport (#7145) · e930526b
  Yuewei Na authored Mar 10, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  e930526b
- chore: skip lmcache tests on cuda13 env (#7196) · 9eec94b2
  Dmitry Tokarev authored Mar 10, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  9eec94b2
07 Mar, 2026 1 commit
- chore: bump trtllm to 1.3.0rc5.post1 (#7040) · 25393fb3
  Harrison Saturley-Hall authored Mar 06, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  25393fb3
03 Mar, 2026 3 commits
- ci: skip completions_only test (#6811) · 51e42e39
  KrishnanPrash authored Mar 03, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  51e42e39
- fix: pass through extra args in trtllm agg.sh launch script (#6787) · 146eb3b4
  KrishnanPrash authored Mar 02, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  146eb3b4
- fix: Fix E + PD Multimodal Flow in trtllm (#6726) · 47ed1227
  Indrajit Bhosale authored Mar 02, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  47ed1227
01 Mar, 2026 1 commit
- chore: fix post merge (#6704) · 1412e44b
  Dmitry Tokarev authored Mar 01, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  1412e44b
28 Feb, 2026 1 commit
- feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633) · e5850e23
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e5850e23
27 Feb, 2026 2 commits
- fix: Phase out llava and make EPD single GPU (#6674) · 4ffa1082
  Indrajit Bhosale authored Feb 27, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  4ffa1082
- chore: migrate vllm e/p/d test from gpu_2 -> gpu_1 (#6638) · b1930a61
  KrishnanPrash authored Feb 27, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b1930a61
24 Feb, 2026 1 commit

fix: restore E/P/D multimodal disagg serving and add Qwen3-VL-30B-A3B support (#6533) · 8e236375

KrishnanPrash authored Feb 24, 2026


Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

8e236375

22 Feb, 2026 1 commit

feat: add --headless mode for multi-node TP/PP in dynamo.vllm (#6204) · 4ebb244b

Alec authored Feb 22, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

4ebb244b

20 Feb, 2026 2 commits
- test: add TensorRT-LLM multimodal EPD test for nightly CI (#6193) · da7d3e9e
  knarangN authored Feb 20, 2026
```
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  da7d3e9e
- feat: add embedding cache to pd worker (#6061) · c82fe888
  Qi Wang authored Feb 20, 2026
  
  c82fe888
19 Feb, 2026 2 commits
- feat: Add runtime.endpoint() method to eliminate namespace chaining (#6386) · 0ce3461a
  Tzu-Ling Kan authored Feb 19, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  0ce3461a
- test: add vllm audio tests to nightly ci pipeline (#6392) · 6f4b33f7
  knarangN authored Feb 19, 2026
```
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  6f4b33f7
18 Feb, 2026 3 commits
- test: Add multimodal video tests to nightly CI pipeline (#6023) · 638d8e68
  knarangN authored Feb 18, 2026
```
Signed-off-by: Kavita Narang <knarang@nvidia.com>
```
  638d8e68
- feat: add Anthropic Messages API endpoint (/v1/messages) (#6231) · b6603d90
  ishandhanani authored Feb 18, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Matej Kosec <mkosec@nvidia.com>
```
  b6603d90
- refactor: delete handlers and disagg EC producer/consumer (#6051) · d2a57839
  Qi Wang authored Feb 17, 2026
  
  d2a57839
13 Feb, 2026 1 commit
- Rename fetch_llm to fetch_model (#6268) · 5624d144
  Tzu-Ling Kan authored Feb 13, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  5624d144
12 Feb, 2026 1 commit
- feat: responses API compliance with upstream type alignment (#6089) · 8cb47d04
  MatejKosec authored Feb 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  8cb47d04
11 Feb, 2026 1 commit
- feat: add Prometheus auto and custom label injection for engine metrics (#5989) · e18840ce
  Keiven C authored Feb 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  e18840ce
03 Feb, 2026 1 commit
- feat: vLLM backend with frontend media decoding (#5781) · 9bff03f2
  milesial authored Feb 03, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  9bff03f2
27 Jan, 2026 1 commit
- test: consolidate guided decoding vLLM configs (#5670) · 2dbfed89
  Alec authored Jan 26, 2026
  
  2dbfed89
22 Jan, 2026 1 commit

feat: Standalone encoder in dynamo trtllm (#4668) · 66963b70

Indrajit Bhosale authored Jan 22, 2026

Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

66963b70

16 Jan, 2026 1 commit
- feat: SGLang aggregated multimodal support (#5450) · ddee21cb
  KrishnanPrash authored Jan 16, 2026
  
  ddee21cb
14 Jan, 2026 2 commits

refactor: vllm EPD refactor (#4994) · 334cbd9b

GuanLuo authored Jan 14, 2026


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

334cbd9b

fix: mypy error (#5426) · 6f68be40
Tzu-Ling Kan authored Jan 14, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
6f68be40

09 Jan, 2026 2 commits
- feat: vllm sglang cuda13 main (#5218) · 4a2235d1
  Dmitry Tokarev authored Jan 09, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  4a2235d1
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
07 Jan, 2026 1 commit
- fix: KvCacheConfig Settings Lost When Publishing Events (#5198) · 66dfc494
  Indrajit Bhosale authored Jan 07, 2026
  
  66dfc494