Commits · 82577b06889f1d3a77c1af2eec8153b923d2d107 · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "06c7d6f542bbea9b87fa26cd581361253d29329a"

11 Dec, 2025 19 commits
- ci: Update the pre_merge markers to exclude gpu_2 tests running (#4909) · 82577b06
  Pavithra Vijayakrishnan authored Dec 11, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  82577b06
- test: remove pytest_runtestloop (#4886) · d0e95c39
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d0e95c39
- feat: install Run:ai model streamer for vllm (#4848) · 53cec4ac
  Guangtong Bai authored Dec 11, 2025
```
Signed-off-by: Guangtong Bai <guangtong.bai@gmail.com>
```
  53cec4ac
- fix: relax pydantic requirements (#4865) · 2ef0f5fb
  Dmitry Tokarev authored Dec 11, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  2ef0f5fb
- docs: update docs to remove KVBM cuda graph limitation (#4902) · 5c2415d8
  Kyle McGill authored Dec 11, 2025
  
  5c2415d8
- fix: remove small --gpu-memory-utilization to avoid OOM due to vllm upgrade (#4899) · 31f31e8e
  Ziqi Fan authored Dec 11, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  31f31e8e
- test: graceful shutdown for tcp req plane (#4883) · 5e96c9a8
  Biswa Panda authored Dec 11, 2025
  
  5e96c9a8
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- ci: Fixing sccache behavior (#4866) · 242a4d5b
  Dillon Cullinan authored Dec 11, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  242a4d5b
- fix: Fix CUDA_VISIBLE_DEVICES for agg_multimodal_epd.sh (#4888) · 9b7152d7
  Kris Hung authored Dec 11, 2025
  
  9b7152d7
- test: add dynamic port allocation for fault_tolerant test execution (#4835) · c6b440e4
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6b440e4
- refactor: simplify, remove --dev-image option from build.sh (#4867) · 111e08c5
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  111e08c5
- feat: add cached tokens prometheus metric (#4534) · f8bb53c0
  Vladislav Nosivskoy authored Dec 11, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f8bb53c0
- feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f
  Yan Ru Pei authored Dec 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  2845aa1f
- chore: TRTLLM 1.2.0rc4 (#4836) · 52503032
  Dmitry Tokarev authored Dec 10, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  52503032
- test: Ensure Request Cancellation, Migration, Rejection Work with TCP transport (#4875) · 00f8615e
  Jacky authored Dec 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  00f8615e
- fix: worker to graceful shutdown after finishing in-flight requests (#4838) · c8845b41
  Hongkuan Zhou authored Dec 10, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  c8845b41
- chore: add gb200 fp4 8k1k (#4874) · 69817c2d
  ishandhanani authored Dec 10, 2025
  
  69817c2d
- test: router + trtllm CI tests (#4805) · ac8d36c6
  Karen Chung authored Dec 10, 2025
  
  ac8d36c6
10 Dec, 2025 14 commits
- fix: Don't set min_tokens when ignore_eos is true (#4872) · 664b458a
  jthomson04 authored Dec 10, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  664b458a
- ci: Disable sccache until its successfully resolved (#4869) · a409b295
  Dillon Cullinan authored Dec 10, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  a409b295
- feat: add webUI to profiler (#4544) · ca0cd3b1
  Hongkuan Zhou authored Dec 10, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  ca0cd3b1
- fix: Fix multimodal EPD examples for vllm version bump (#4849) · 0173d5e6
  Kris Hung authored Dec 11, 2025
  
  0173d5e6
- test: add ci tests for lora (agg and router) (#4817) · acab6367
  Biswa Panda authored Dec 10, 2025
  
  acab6367
- fix: remove pod normalization logic (#4853) · 0a517dc0
  Julien Mancuso authored Dec 10, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  0a517dc0
- ci: re enable sgl unit tests and remove pyproject.toml from runtime image (#4803) · cf269dba
  Anant Sharma authored Dec 10, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  cf269dba
- fix: sccache compiler launcher errors when sccache is disabled (#4846) · cc2ee1ed
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  cc2ee1ed
- feat: non blocking radix snapshot upload (#4839) · c7ad78f3
  Yan Ru Pei authored Dec 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c7ad78f3
- feat: vLLM pre/postprocessing in-framework (#4529) · fe10dbfd
  jthomson04 authored Dec 09, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  fe10dbfd
- feat: KVBM V2 optimized bounce buffer transfer + benchmark (#3947) · 01819b87
  jthomson04 authored Dec 09, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  01819b87
- feat: Add logprobs support to vLLM backend (#4683) (#4697) · f57fd72f
  Aryan Bagade authored Dec 09, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f57fd72f
- feat: DeepSeek V3.2 tool calling support (#4822) · 6d091bf3
  Vladislav Nosivskoy authored Dec 10, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
```
  6d091bf3
- ci: OPS-2136: Setup caching for docker build (#4535) · c9e445a9
  Dillon Cullinan authored Dec 09, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Dillon Cullinan <dillon-cullinan@users.noreply.github.com>
Co-authored-by: Dillon Cullinan <dillon-cullinan@users.noreply.github.com>
```
  c9e445a9
09 Dec, 2025 7 commits
- feat: nixl_connect: Improve Concurrency Support (#4433) · 96fe63fe
  J Wyman authored Dec 09, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
```
  96fe63fe
- chore: fix cache flush template (#4809) · 0ce7280d
  Neal Vaidya authored Dec 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  0ce7280d
- feat: make planner use DGD Scaling Adapters (#4825) · 9573d34c
  Julien Mancuso authored Dec 09, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9573d34c
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- chore: cleanups of passing around prefill and decode worker ids (#4829) · 1e5b20b2
  Yan Ru Pei authored Dec 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1e5b20b2
- feat: add a grafana dashboard for planner (#4815) · 14321c8f
  Hongkuan Zhou authored Dec 09, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  14321c8f
- fix: backend error serialization and add HTTP status code detection (#4786) · 065f466e
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  065f466e