Commits · a77558d442bb35f577cf20be02d7d2b59562cea6 · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "26f976c1910204d419625c96b0b9ae769b2d172c"

25 Nov, 2025 2 commits
- feat: allow dynamic port in scripts in preparation for parallel testing (part 1) (#4546) · a77558d4
  Keiven C authored Nov 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a77558d4
- fix: expose prefill worker id in disagg (#4563) · 57c701fb
  Yan Ru Pei authored Nov 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  57c701fb
22 Nov, 2025 2 commits

feat: Add k8s Fault Tolerance Validations infra (#4067) · c0e394d5

Indrajit Bhosale authored Nov 21, 2025


Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Claude <noreply@anthropic.com>

c0e394d5

chore: unify LMCache UX w/ and w/o Dynamo (#4509) · 6d69e8c7
Ziqi Fan authored Nov 21, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
6d69e8c7

21 Nov, 2025 3 commits
- chore: parallelize planner profile tests + bindings test cleanup (#4532) · d821a8b9
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d821a8b9
- ci: Testing b64 multimodal support with real image (#4280) · e7544f19
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  e7544f19
- test: parallel mocker tests in CI (#4493) · 6e241236
  Yan Ru Pei authored Nov 20, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6e241236
20 Nov, 2025 3 commits

fix: Support for msg[content] as a list (#4485) · 6767559f

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6767559f

fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
75bf7c9b
test: Router CI tests with vLLM engine (#3948) · d461631b
Karen Chung authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
d461631b

19 Nov, 2025 4 commits
- feat: Enable autodeploy as a backend for TRT-LLM (#4347) · fe21d3dd
  William Zhang authored Nov 19, 2025
```
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
```
  fe21d3dd
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- ci: TRT-LLM multimodal CI (#4118) · a8e5328e
  Indrajit Bhosale authored Nov 19, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  a8e5328e
- feat: Request Cancellation when transitioning from Prefill to Decode at KV Prefill Router (#4449) · 04486c1d
  Jacky authored Nov 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  04486c1d
18 Nov, 2025 2 commits

fix: TENSORRTLLM_PIP_WHEEL_DIR has reasonable default set when building and... · 771d8c02
Kyle McGill authored Nov 18, 2025
```
fix: TENSORRTLLM_PIP_WHEEL_DIR has reasonable default set when building and installing TRTLLM from source (#4414)
```
771d8c02

docs: Clean up incomplete recipes and clarify Kubernetes-only focus (#4159) · 88dfd1b3

Ben Hamm authored Nov 17, 2025


Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: atchernych <atchernych@nvidia.com>

88dfd1b3

17 Nov, 2025 2 commits
- refactor: centralize environment variable constants (#4083) · 0e77d344
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0e77d344
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
16 Nov, 2025 1 commit
- test: Deterministic ETCD client failover tests (#4363) · ed8cd590
  Jacky authored Nov 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  ed8cd590
14 Nov, 2025 1 commit
- docs: add instructions in planner tests to remove volumes/volumeMounts (#4335) · 9f0a3155
  hhzhang16 authored Nov 14, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  9f0a3155
13 Nov, 2025 6 commits
- test(key_value_store): Assert entries() works correctly (#4312) · 58da7cfe
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  58da7cfe
- feat: Add vLLM multimodal audio support (#2760) · 0f5dd2b7
  Yuekai Zhang authored Nov 14, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  0f5dd2b7
- fix: TRTLLM build from source not repsecting the wheel installation directory (#4241) · 02763376
  Kyle McGill authored Nov 13, 2025
```
Signed-off-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  02763376
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c
  Keiven C authored Nov 13, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  381c428c
- feat: Add DYN_SYSTEM_ENABLED=True (#4279) · 8a63d9ce
  Tzu-Ling Kan authored Nov 12, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  8a63d9ce
12 Nov, 2025 3 commits
- fix: append namespace to planner pod names in tests (#4273) · bb7d203f
  hhzhang16 authored Nov 12, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  bb7d203f
- chore: make Router non-reliant on etcd (#4244) · 4d86f347
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4d86f347
- feat: KVBM V2 transfer (#4068) · 827b8c3e
  jthomson04 authored Nov 12, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  827b8c3e
11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
10 Nov, 2025 3 commits

fix: Fix the wrong path of deep_ep kernel (#4205) · b1618963
Tzu-Ling Kan authored Nov 10, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
b1618963

feat: DynamoPlanner profiler to use hf_id for AIConfigurator 0.4.0 (#4167) · 43986372

Jason Zhou authored Nov 10, 2025


Signed-off-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
Co-authored-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>

43986372

refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) · afccc9d4

Keiven C authored Nov 10, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

afccc9d4

08 Nov, 2025 1 commit
- ci: Skip broken etcd_ha tests until fixed to unblock unrelated PRs (#4198) · 560bb2fc
  Ryan McCormick authored Nov 07, 2025
  
  560bb2fc
07 Nov, 2025 6 commits
- feat: enable HTTP completion endpoint to accept arrays of prompts and generate... · 93ada899
  zhongdaor-nv authored Nov 07, 2025
```
feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  93ada899
- feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) · 6bccf099
  Keiven C authored Nov 07, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6bccf099
- ci: Add Fault Tolerance K8s test (#3801) · d1cf3c2c
  Indrajit Bhosale authored Nov 07, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  d1cf3c2c
- test: Skip flaky `test_vllm_health_check_active` until properly resolved (#4188) · 3ff5fa13
  Ryan McCormick authored Nov 07, 2025
  
  3ff5fa13
- feat(keyvalue): Filesystem backed KeyValueStore (#4138) · 794c0a44
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  794c0a44
- feat: add parallelization filters (#4144) · 7750ed1a
  Hongkuan Zhou authored Nov 07, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  7750ed1a