Commits · be9d6b2bc9bbca2cf1a011e780610b2fe4fef93f · OpenDAS / dynamo

"lib/llm/vscode:/vscode.git/clone" did not exist on "ffb5409615d66f513445025e674479aeb7b32191"

18 Nov, 2025 16 commits
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
- fix: use --num-dataset-entries instead of --conversation-num (#4439) · 0f4d7634
  Anthony Casagrande authored Nov 18, 2025
  
  0f4d7634
- feat: add custom gpu type to CRD (#4408) · 9caafa55
  Thomas Montfort authored Nov 18, 2025
  
  9caafa55
- fix: Set annotated_usage.event to None in the final usage chunk response (#3729) · 33d9ae78
  Shuaiyi Zhang authored Nov 19, 2025
```
Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  33d9ae78
- fix: Mark enable_kv_events=True for user-specified vLLM KVEventsConfig in scripts (#4418) · 7b967c77
  Karen Chung authored Nov 18, 2025
```
Signed-off-by: Karen Chung <karenc@nvidia.com>
```
  7b967c77
- fix(storage): File store shouldn't notify on metdata changes (#4434) · 2f1778c1
  Graham King authored Nov 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2f1778c1
- feat: nixl_connect: Change the way `bytes` are passed to NIXL (#4314) · 08146531
  J Wyman authored Nov 18, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  08146531
- fix: TENSORRTLLM_PIP_WHEEL_DIR has reasonable default set when building and... · 771d8c02
  Kyle McGill authored Nov 18, 2025
```
fix: TENSORRTLLM_PIP_WHEEL_DIR has reasonable default set when building and installing TRTLLM from source (#4414)
```
  771d8c02
- feat: mocker can use planner profile data (#4422) · fc2ad4eb
  Yan Ru Pei authored Nov 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  fc2ad4eb
- fix: point to new sglang container and rm references to old (#4383) · 48c340f4
  ishandhanani authored Nov 17, 2025
  
  48c340f4
- fix: add kv events config in agg_router sglang example (#4391) · cf64ca7c
  Vladislav Nosivskoy authored Nov 18, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  cf64ca7c
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
- feat: discovery traits, systems and managers (#4070) · 4d3269cd
  Ryan Olson authored Nov 17, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  4d3269cd
- fix: Fix cublas and cublasLt symlinks in vLLM runtime container (#4421) · 1a27649c
  jthomson04 authored Nov 17, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1a27649c
- fix: Fix port collision and pass prefill param in kvbm connector (#4411) · e3cee95f
  Kris Hung authored Nov 17, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  e3cee95f
- docs: Clean up incomplete recipes and clarify Kubernetes-only focus (#4159) · 88dfd1b3
  Ben Hamm authored Nov 17, 2025
```
Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: atchernych <atchernych@nvidia.com>
```
  88dfd1b3
17 Nov, 2025 11 commits
- feat: kvbm kernels (#4356) · 09bb1c68
  Ryan Olson authored Nov 17, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  09bb1c68
- fix: change labels to annotations in reference dgd (#4410) · adbe133c
  mohammedabdulwahhab authored Nov 17, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  adbe133c
- ci: Disable deploy tests (#4397) · e5f7ee9f
  Dillon Cullinan authored Nov 17, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  e5f7ee9f
- fix: Install jq in trtllm runtime container (#4398) · 54addb54
  Tushar Sharma authored Nov 17, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  54addb54
- fix: workaround vllm prometheus cleanup error on shutdown (#4323) · 6afb4d5b
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6afb4d5b
- refactor: centralize environment variable constants (#4083) · 0e77d344
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0e77d344
- fix: DSR1 DEP Prefill Profiling Benchmark (#4367) · cf97c0dc
  Hongkuan Zhou authored Nov 17, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cf97c0dc
- feat: convert profiler perf data for mocker to use (#4370) · 24af5a33
  Hongkuan Zhou authored Nov 17, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  24af5a33
- ci: Output node name in workflows (#4350) · fa28b1ac
  Dillon Cullinan authored Nov 17, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  fa28b1ac
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
- fix: fix trtllm multinode DGD (#4389) · 9f3d1b90
  Julien Mancuso authored Nov 17, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  9f3d1b90
16 Nov, 2025 1 commit
- test: Deterministic ETCD client failover tests (#4363) · ed8cd590
  Jacky authored Nov 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  ed8cd590
15 Nov, 2025 1 commit
- docs: Update vllm multimodal EPD doc (#4352) · 1e120ed0
  Kris Hung authored Nov 15, 2025
  
  1e120ed0
14 Nov, 2025 11 commits
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
- fix: rm dynamoNamespace from GAIE example (#4313) · 84737baf
  atchernych authored Nov 14, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
```
  84737baf
- fix(runtime): Handle dropping the tokio runtime in async context (#4343) · 611c213b
  Graham King authored Nov 14, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  611c213b
- fix: fix permission issues with volume mounts and trtllm multinode (#4341) · 7702f49f
  Julien Mancuso authored Nov 14, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  7702f49f
- fix: use release build for ucx (#4345) · 2405bac7
  Anant Sharma authored Nov 14, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  2405bac7
- fix: misnamed tensorrtllm-runtime image and incorrect tag (#4289) · a4eb4e8a
  Harrison Saturley-Hall authored Nov 14, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <harrison.saturley.hall@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  a4eb4e8a
- fix: revert space making DGD invalid (#4349) · dce20d06
  Alec authored Nov 14, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  dce20d06
- refactor: migrate kvbm python bindings to the python directory (#4318) · 5a5bc51e
  Ryan Olson authored Nov 14, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  5a5bc51e
- fix: k8s native discovery (#4305) · 334ce551
  Thomas Montfort authored Nov 14, 2025
  
  334ce551
- feat: Use try-catch block for import to avoid error (#4339) · 9a765d6d
  Tzu-Ling Kan authored Nov 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  9a765d6d
- chore: use hyphens for Router-related keys (#4325) · 065296c3
  Yan Ru Pei authored Nov 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  065296c3