Commits · 3c7ed61d05d153075b46d3a5e278c7d72c76f8e1 · OpenDAS / dynamo

31 Dec, 2025 2 commits

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

test: fix missing args in replica calculation test (#5113) · 2fa3627a
Hongkuan Zhou authored Dec 30, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
2fa3627a

20 Dec, 2025 1 commit

test: pytest mark checker (#4812) · 5034b144

Pavithra Vijayakrishnan authored Dec 19, 2025


Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>

5034b144

19 Dec, 2025 5 commits
- refactor: frontend/test_vllm.py to use shared dynamic ports (#5013) · 28044799
  Keiven C authored Dec 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  28044799
- feat: Request Migration Metrics (#5029) · e6a6a1f2
  Jacky authored Dec 19, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e6a6a1f2
- test: enable Router gap detection test (#5023) · 1247fe31
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1247fe31
- refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc
  Keiven C authored Dec 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c22280cc
- test: Adding three basic KVBM integration tests for GitHub Actions CI (#5019) · cd7b1492
  Olga Andreeva authored Dec 18, 2025
  
  cd7b1492
18 Dec, 2025 6 commits
- feat: switch to tcp as default request plane (#4845) · 18b64e90
  Biswa Panda authored Dec 18, 2025
  
  18b64e90
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
- refactor: consolidate fault_tolerance DynamoFrontendProcess, add timeouts (#5008) · f10f5942
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f10f5942
- fix: Remove debug logging from aiperf benchmarking (#5010) · e1c685b1
  Tanmay Verma authored Dec 17, 2025
  
  e1c685b1
- refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1b8869f5
- test: update lora tests (#4996) · 9be3df8f
  Pavithra Vijayakrishnan authored Dec 17, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  9be3df8f
17 Dec, 2025 3 commits
- chore: Add vllm multimodal tests to pre_merge (#4889) · fb1b4f92
  Kris Hung authored Dec 18, 2025
  
  fb1b4f92
- fix: make gap detection work e2e (#4993) · 0fba01c2
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0fba01c2
- test: Add pre-download model test that run at beginning avoiding individual test timeout (#4989) · 54636097
  Jacky authored Dec 16, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  54636097
16 Dec, 2025 3 commits
- fix: Set max_tokens_in_buffer on TRT-LLM cache transceiver (#4703) · 32eaecb4
  Jacky authored Dec 16, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  32eaecb4
- test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf
  Keiven C authored Dec 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6da23fcf
- chore: add test for diverging prefixes (#4919) · 29ec4969
  Neal Vaidya authored Dec 15, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  29ec4969
13 Dec, 2025 1 commit
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
12 Dec, 2025 3 commits
- feat: support decentralized router with NATs core (#4921) · ef3027bd
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ef3027bd
- fix: cleaner prefill + decode discovery (#4927) · feb49914
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb49914
- test: remove tcp test xfail for tcp after automatic port assignments (#4916) · 44f57a22
  Biswa Panda authored Dec 11, 2025
  
  44f57a22
11 Dec, 2025 7 commits
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- test: remove pytest_runtestloop (#4886) · d0e95c39
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d0e95c39
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- test: add dynamic port allocation for fault_tolerant test execution (#4835) · c6b440e4
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6b440e4
- feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f
  Yan Ru Pei authored Dec 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  2845aa1f
- test: Ensure Request Cancellation, Migration, Rejection Work with TCP transport (#4875) · 00f8615e
  Jacky authored Dec 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  00f8615e
- test: router + trtllm CI tests (#4805) · ac8d36c6
  Karen Chung authored Dec 10, 2025
  
  ac8d36c6
10 Dec, 2025 3 commits

feat: add webUI to profiler (#4544) · ca0cd3b1

Hongkuan Zhou authored Dec 10, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

ca0cd3b1

test: add ci tests for lora (agg and router) (#4817) · acab6367
Biswa Panda authored Dec 10, 2025

acab6367

feat: Add logprobs support to vLLM backend (#4683) (#4697) · f57fd72f

Aryan Bagade authored Dec 09, 2025


Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

f57fd72f

09 Dec, 2025 6 commits
- feat: make planner use DGD Scaling Adapters (#4825) · 9573d34c
  Julien Mancuso authored Dec 09, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9573d34c
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- chore: cleanups of passing around prefill and decode worker ids (#4829) · 1e5b20b2
  Yan Ru Pei authored Dec 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1e5b20b2
- feat: fault tolerance rolling upgrade test scenarios (#4558) · a473402f
  Thomas Montfort authored Dec 09, 2025
  
  a473402f
- test: Pre-download models before tests are ran (#4811) · 4ca1679c
  Jacky authored Dec 08, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  4ca1679c
- fix: guided decoding params handling in vLLM (#4770) · 3e4b480b
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
```
  3e4b480b