Commits · 10b01b45908c2640d97b88b8a3024a56262a353d · OpenDAS / dynamo

"fern/pages/backends/vllm/multi-node.md" did not exist on "0a2a820bcacda705d927c6fdfcf37ec076e4e3fd"

11 Dec, 2025 7 commits
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- test: remove pytest_runtestloop (#4886) · d0e95c39
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d0e95c39
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- test: add dynamic port allocation for fault_tolerant test execution (#4835) · c6b440e4
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6b440e4
- feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f
  Yan Ru Pei authored Dec 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  2845aa1f
- test: Ensure Request Cancellation, Migration, Rejection Work with TCP transport (#4875) · 00f8615e
  Jacky authored Dec 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  00f8615e
- test: router + trtllm CI tests (#4805) · ac8d36c6
  Karen Chung authored Dec 10, 2025
  
  ac8d36c6
10 Dec, 2025 3 commits

feat: add webUI to profiler (#4544) · ca0cd3b1

Hongkuan Zhou authored Dec 10, 2025


Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

ca0cd3b1

test: add ci tests for lora (agg and router) (#4817) · acab6367
Biswa Panda authored Dec 10, 2025

acab6367

feat: Add logprobs support to vLLM backend (#4683) (#4697) · f57fd72f

Aryan Bagade authored Dec 09, 2025


Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

f57fd72f

09 Dec, 2025 7 commits
- feat: make planner use DGD Scaling Adapters (#4825) · 9573d34c
  Julien Mancuso authored Dec 09, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9573d34c
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- chore: cleanups of passing around prefill and decode worker ids (#4829) · 1e5b20b2
  Yan Ru Pei authored Dec 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1e5b20b2
- feat: fault tolerance rolling upgrade test scenarios (#4558) · a473402f
  Thomas Montfort authored Dec 09, 2025
  
  a473402f
- test: Pre-download models before tests are ran (#4811) · 4ca1679c
  Jacky authored Dec 08, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  4ca1679c
- fix: guided decoding params handling in vLLM (#4770) · 3e4b480b
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
```
  3e4b480b
- feat: migrate planner metrics to backend (1/3 vLLM) (#4134) · 197e0227
  daiyaanarfeen authored Dec 08, 2025
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
```
  197e0227
08 Dec, 2025 4 commits
- test: router + sglang in pre-merge CI (#4767) · 3fea2e10
  Yan Ru Pei authored Dec 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3fea2e10
- feat(fault-injection): Enable runtime CUDA fault injection toggling without pod restarts (#4679) · d2c23e41
  nv-oviya authored Dec 08, 2025
  
  d2c23e41
- fix: increase timeout for test_{sglang,vllm,trtllm} model download time (#4792) · 300e5d55
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  300e5d55
- ci: fix login for operator job and other sgl/trtllm tests (#4785) · 1645884d
  Dillon Cullinan authored Dec 08, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  1645884d
06 Dec, 2025 3 commits
- fix: restoring KVBM wheel generation for `framework=none` and adding CI validation (#4772) · 046229f2
  Olga Andreeva authored Dec 05, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  046229f2
- fix: Extra requests received by workers during FT tests (#4780) · d66e6755
  Jacky authored Dec 05, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  d66e6755
- test: add timeout markers to pytest.mark.gpu_1 serve tests (#4768) · 2472aa4a
  Keiven C authored Dec 05, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  2472aa4a
05 Dec, 2025 1 commit
- test: Include a timeout marker to all Cancellation / Migration E2E tests (#4764) · 0fa9b998
  Jacky authored Dec 05, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  0fa9b998
04 Dec, 2025 8 commits
- test: Extend Migration Tests to SGLang (#4711) · b8c4a5f5
  Jacky authored Dec 04, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  b8c4a5f5
- test: Extend Migration Tests to TRT-LLM (#4709) · a689c4b8
  Jacky authored Dec 04, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  a689c4b8
- fix: skip HuggingFace download for non-llms (#4686) · 118323f2
  Neal Vaidya authored Dec 04, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  118323f2
- refactor: remove legacy NATS metrics and stats_handler (#4680) · 00b64ae0
  Keiven C authored Dec 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  00b64ae0
- test: reenable router + vllm tests (#4746) · 67273aba
  Yan Ru Pei authored Dec 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  67273aba
- fix: Use /proc/driver/nvidia/gpus to get PCI addresses (#4717) · 37d0fc88
  Tzu-Ling Kan authored Dec 03, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  37d0fc88
- feat: Add GPU discovery utilities (#4695) · c0992522
  Tzu-Ling Kan authored Dec 03, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  c0992522
- test: Multimodal Tool Calling vLLM Test (#4663) · 0651a4fe
  Indrajit Bhosale authored Dec 03, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0651a4fe
03 Dec, 2025 7 commits
- chore: bump vLLM to 0.11.2 (#4476) · 60feb955
  Karen Chung authored Dec 03, 2025
  
  60feb955
- feat: add Kserve readiness endpoint support: ServerLive / ServerReady / ModelReady (#4708) · d90dc39d
  GuanLuo authored Dec 03, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  d90dc39d
- test: add AIConfigurator dense model tests for Dynamo Planner Profiler (#4526) · 2f2a13a3
  Jason Zhou authored Dec 02, 2025
```
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
```
  2f2a13a3
- fix: enable LMCache metrics visibility with PROMETHEUS_MULTIPROC_DIR (#4654) · c6555852
  Keiven C authored Dec 02, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6555852
- test: bring back the framework 1 gpu pre-merge tests + clean up pytest markers (#4698) · 7e499b5c
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e499b5c
- fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port... · 3cad926e
  Keiven C authored Dec 02, 2025
```
fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port binding, and update etcd test (#4687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3cad926e
- refactor: Replace hyphens from paths (#4701) · 769fae9e
  Tzu-Ling Kan authored Dec 02, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  769fae9e