Commits · edf847e5e176eed72f284afff85af2102e20c8f8 · OpenDAS / dynamo

22 Jan, 2026 3 commits

feat: Standalone encoder in dynamo trtllm (#4668) · 66963b70

Indrajit Bhosale authored Jan 22, 2026

Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

66963b70

fix: TestProfileSlaAiconfigurator should use new framework versions (#5562) · e861f619
Jason Zhou authored Jan 22, 2026

e861f619
feat: predict log1p(y) instead of y in load predictor if ARIMA collapses (#5545) · 4557b6df
Hongkuan Zhou authored Jan 21, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
4557b6df

21 Jan, 2026 1 commit
- test: Fixing kvbm tests/ adding concurrency test (#5474) · 224f63f5
  Olga Andreeva authored Jan 21, 2026
  
  224f63f5
20 Jan, 2026 2 commits
- feat: Support Dynamo KVBM with TRTLLM Disagg (#3527) · bf19823d
  jthomson04 authored Jan 20, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  bf19823d
- test: Auto-start services for prompt_embed_tests.py (#5491) · e076f3a2
  Graham King authored Jan 20, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e076f3a2
16 Jan, 2026 1 commit
- feat: SGLang aggregated multimodal support (#5450) · ddee21cb
  KrishnanPrash authored Jan 16, 2026
  
  ddee21cb
14 Jan, 2026 2 commits

refactor: vllm EPD refactor (#4994) · 334cbd9b

GuanLuo authored Jan 14, 2026


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

334cbd9b

fix: mypy error (#5426) · 6f68be40
Tzu-Ling Kan authored Jan 14, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
6f68be40

13 Jan, 2026 2 commits
- chore: Revert KVBM v2 transfer integration (#5406) · 9ca2923d
  jthomson04 authored Jan 13, 2026
  
  9ca2923d
- chore: Update aiperf pinned version (#5331) · c3dc3de4
  Elias Bermudez authored Jan 13, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  c3dc3de4
12 Jan, 2026 1 commit
- feat: normalize dynamo namespace computation (#5231) · c8770464
  hhzhang16 authored Jan 12, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  c8770464
10 Jan, 2026 1 commit
- fix: test_cuda_version_consistency.py - remove wrong marker (#5338) · 91eb0ed8
  Dmitry Tokarev authored Jan 10, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  91eb0ed8
09 Jan, 2026 3 commits
- feat: vllm sglang cuda13 main (#5218) · 4a2235d1
  Dmitry Tokarev authored Jan 09, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  4a2235d1
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
- fix: KServe propagate error to client in stream infer (#5263) · bb8eaa23
  GuanLuo authored Jan 08, 2026
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  bb8eaa23
08 Jan, 2026 1 commit
- feat(vllm): Add prompt embeds support for pre-computed inference inputs (#4739) · 6f9619a2
  Wenqi Glantz authored Jan 08, 2026
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  6f9619a2
07 Jan, 2026 2 commits
- revert: remove vLLM backend metrics from planner (#4134) (#5185) · daa1d740
  daiyaanarfeen authored Jan 07, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
```
  daa1d740
- fix: KvCacheConfig Settings Lost When Publishing Events (#5198) · 66dfc494
  Indrajit Bhosale authored Jan 07, 2026
  
  66dfc494
06 Jan, 2026 1 commit
- fix: Fix consolidator tests by computing the number of requests needed to... · f7f2fb26
  Kyle McGill authored Jan 06, 2026
```
fix: Fix consolidator tests by computing the number of requests needed to trigger an expected pass (#5220)
```
  f7f2fb26
05 Jan, 2026 3 commits

test: Resolving wrong model for testing (#5135) · 99ab75b8

Olga Andreeva authored Jan 05, 2026

Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

99ab75b8

fix: trtllm has moved to version 1.2+ to enable cuda graph testing; fixed path... · 6be9c9a4
Kyle McGill authored Jan 05, 2026
```
fix: trtllm has moved to version 1.2+ to enable cuda graph testing; fixed path to config.yaml (#5133)
```
6be9c9a4
feat: support PVC model cache in profiler (#5124) · fbe6bb0a
Hongkuan Zhou authored Jan 05, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
fbe6bb0a

04 Jan, 2026 1 commit
- fix: sglang metrics and prefill router fix (#5147) · 007c5b60
  ishandhanani authored Jan 04, 2026
  
  007c5b60
03 Jan, 2026 1 commit
- feat: mockers with bootstrap optimization (sglang testing) + CI test (#5121) · 0980b27f
  Yan Ru Pei authored Jan 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0980b27f
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 2 commits

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

test: fix missing args in replica calculation test (#5113) · 2fa3627a
Hongkuan Zhou authored Dec 30, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
2fa3627a

20 Dec, 2025 1 commit

test: pytest mark checker (#4812) · 5034b144

Pavithra Vijayakrishnan authored Dec 19, 2025


Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>

5034b144

19 Dec, 2025 5 commits
- refactor: frontend/test_vllm.py to use shared dynamic ports (#5013) · 28044799
  Keiven C authored Dec 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  28044799
- feat: Request Migration Metrics (#5029) · e6a6a1f2
  Jacky authored Dec 19, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e6a6a1f2
- test: enable Router gap detection test (#5023) · 1247fe31
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1247fe31
- refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc
  Keiven C authored Dec 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c22280cc
- test: Adding three basic KVBM integration tests for GitHub Actions CI (#5019) · cd7b1492
  Olga Andreeva authored Dec 18, 2025
  
  cd7b1492
18 Dec, 2025 6 commits
- feat: switch to tcp as default request plane (#4845) · 18b64e90
  Biswa Panda authored Dec 18, 2025
  
  18b64e90
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
- refactor: consolidate fault_tolerance DynamoFrontendProcess, add timeouts (#5008) · f10f5942
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f10f5942
- fix: Remove debug logging from aiperf benchmarking (#5010) · e1c685b1
  Tanmay Verma authored Dec 17, 2025
  
  e1c685b1
- refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1b8869f5
- test: update lora tests (#4996) · 9be3df8f
  Pavithra Vijayakrishnan authored Dec 17, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  9be3df8f