Commits · b401a1d66f1389e5490fa0f5cc7186da3ca49425 · OpenDAS / dynamo

"docs/vscode:/vscode.git/clone" did not exist on "176173989a4c5d9c3a4dca8c788d3492ac27a2e0"

18 Dec, 2025 5 commits
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
- refactor: consolidate fault_tolerance DynamoFrontendProcess, add timeouts (#5008) · f10f5942
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f10f5942
- fix: Remove debug logging from aiperf benchmarking (#5010) · e1c685b1
  Tanmay Verma authored Dec 17, 2025
  
  e1c685b1
- refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5
  Keiven C authored Dec 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1b8869f5
- test: update lora tests (#4996) · 9be3df8f
  Pavithra Vijayakrishnan authored Dec 17, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  9be3df8f
17 Dec, 2025 3 commits
- chore: Add vllm multimodal tests to pre_merge (#4889) · fb1b4f92
  Kris Hung authored Dec 18, 2025
  
  fb1b4f92
- fix: make gap detection work e2e (#4993) · 0fba01c2
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0fba01c2
- test: Add pre-download model test that run at beginning avoiding individual test timeout (#4989) · 54636097
  Jacky authored Dec 16, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  54636097
16 Dec, 2025 3 commits
- fix: Set max_tokens_in_buffer on TRT-LLM cache transceiver (#4703) · 32eaecb4
  Jacky authored Dec 16, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  32eaecb4
- test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf
  Keiven C authored Dec 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6da23fcf
- chore: add test for diverging prefixes (#4919) · 29ec4969
  Neal Vaidya authored Dec 15, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  29ec4969
13 Dec, 2025 1 commit
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
12 Dec, 2025 3 commits
- feat: support decentralized router with NATs core (#4921) · ef3027bd
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ef3027bd
- fix: cleaner prefill + decode discovery (#4927) · feb49914
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb49914
- test: remove tcp test xfail for tcp after automatic port assignments (#4916) · 44f57a22
  Biswa Panda authored Dec 11, 2025
  
  44f57a22
11 Dec, 2025 7 commits
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- test: remove pytest_runtestloop (#4886) · d0e95c39
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d0e95c39
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- test: add dynamic port allocation for fault_tolerant test execution (#4835) · c6b440e4
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6b440e4
- feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f
  Yan Ru Pei authored Dec 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  2845aa1f
- test: Ensure Request Cancellation, Migration, Rejection Work with TCP transport (#4875) · 00f8615e
  Jacky authored Dec 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  00f8615e
- test: router + trtllm CI tests (#4805) · ac8d36c6
  Karen Chung authored Dec 10, 2025
  
  ac8d36c6
10 Dec, 2025 3 commits

feat: add webUI to profiler (#4544) · ca0cd3b1

Hongkuan Zhou authored Dec 10, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

ca0cd3b1

test: add ci tests for lora (agg and router) (#4817) · acab6367
Biswa Panda authored Dec 10, 2025

acab6367

feat: Add logprobs support to vLLM backend (#4683) (#4697) · f57fd72f

Aryan Bagade authored Dec 09, 2025


Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

f57fd72f

09 Dec, 2025 7 commits
- feat: make planner use DGD Scaling Adapters (#4825) · 9573d34c
  Julien Mancuso authored Dec 09, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9573d34c
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- chore: cleanups of passing around prefill and decode worker ids (#4829) · 1e5b20b2
  Yan Ru Pei authored Dec 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1e5b20b2
- feat: fault tolerance rolling upgrade test scenarios (#4558) · a473402f
  Thomas Montfort authored Dec 09, 2025
  
  a473402f
- test: Pre-download models before tests are ran (#4811) · 4ca1679c
  Jacky authored Dec 08, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  4ca1679c
- fix: guided decoding params handling in vLLM (#4770) · 3e4b480b
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
```
  3e4b480b
- feat: migrate planner metrics to backend (1/3 vLLM) (#4134) · 197e0227
  daiyaanarfeen authored Dec 08, 2025
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
```
  197e0227
08 Dec, 2025 4 commits
- test: router + sglang in pre-merge CI (#4767) · 3fea2e10
  Yan Ru Pei authored Dec 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3fea2e10
- feat(fault-injection): Enable runtime CUDA fault injection toggling without pod restarts (#4679) · d2c23e41
  nv-oviya authored Dec 08, 2025
  
  d2c23e41
- fix: increase timeout for test_{sglang,vllm,trtllm} model download time (#4792) · 300e5d55
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  300e5d55
- ci: fix login for operator job and other sgl/trtllm tests (#4785) · 1645884d
  Dillon Cullinan authored Dec 08, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  1645884d
06 Dec, 2025 3 commits
- fix: restoring KVBM wheel generation for `framework=none` and adding CI validation (#4772) · 046229f2
  Olga Andreeva authored Dec 05, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  046229f2
- fix: Extra requests received by workers during FT tests (#4780) · d66e6755
  Jacky authored Dec 05, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  d66e6755
- test: add timeout markers to pytest.mark.gpu_1 serve tests (#4768) · 2472aa4a
  Keiven C authored Dec 05, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  2472aa4a
05 Dec, 2025 1 commit
- test: Include a timeout marker to all Cancellation / Migration E2E tests (#4764) · 0fa9b998
  Jacky authored Dec 05, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  0fa9b998