Commits · 3865a94148340dc9b8b05105338aa4f8da94a8f3 · OpenDAS / dynamo

"lib/llm/src/vscode:/vscode.git/clone" did not exist on "cd5e7e3393ddce77788cf9a00f287a4e82ad1a65"

19 Sep, 2025 10 commits
- feat: Port vllm port allocator to Rust in bindings (#3125) · 3865a941
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  3865a941
- feat: Add --use-ai-configurator to profile_sla.py (#3079) · 19948b7f
  Ilya Sherstyuk authored Sep 19, 2025
```
Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  19948b7f
- chore(CODEOWNERS): Manage permissions by team not by individual (#3142) · 8534d170
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8534d170
- feat: KVBM connector : enabling vectorized copy from pinned memory to device... · 2d39f1b1
  Olga Andreeva authored Sep 19, 2025
```
feat: KVBM connector : enabling vectorized copy from pinned memory to device memory and vice versa (#2989)
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: oandreeva-nv <oandreeva-nv@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: oandreeva-nv <oandreeva-nv@nvidia.com>
```
  2d39f1b1
- feat: Convert message[content] from list to string. (#3067) · 5abea1be
  KrishnanPrash authored Sep 19, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  5abea1be
- feat: Sglang canary health check (#3103) · 56f423c6
  Tzu-Ling Kan authored Sep 19, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  56f423c6
- build: OPS-597, OPS-861 restructure TRT-LLM to follow container strategy... · 8c89a555
  Tushar Sharma authored Sep 19, 2025
```
build: OPS-597, OPS-861 restructure TRT-LLM to follow container strategy structure + add gating tests for public CI (#3009)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  8c89a555
- build: update trtllm to v1.1.0rc5 to enable trtllm + KVBM integration (#3119) · fb29bd5a
  Richard Huo authored Sep 19, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  fb29bd5a
- feat: Request Cancellation unary request support (#3004) · a8fd1271
  Jacky authored Sep 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  a8fd1271
- refactor: simplify Dockerfile.vllm, enable local-dev for all frameworks (#3099) · 10bfb73a
  Keiven C authored Sep 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  10bfb73a
18 Sep, 2025 16 commits
- feat(operator): mechanism for disabling imagePullSecrets discovery (#3092) · 70a8aa3f
  Thomas Montfort authored Sep 18, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  70a8aa3f
- feat: enhance GPT OSS frontend with improved harmony tool calling parser and... · 6675bfc8
  zhongdaor-nv authored Sep 18, 2025
```
feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  6675bfc8
- feat: remove kubectl dependencies from benchmarking (#3098) · 20b7a8ae
  hhzhang16 authored Sep 18, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  20b7a8ae
- feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2
  Chi McIsaac authored Sep 18, 2025
```
feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  3b6dbef2
- chore: add dsr1 k8s yaml (#3101) · 00061061
  Hongkuan Zhou authored Sep 18, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  00061061
- fix: add prometheus_client to dep instead of transitive dependency (#3083) · c34f945b
  Hongkuan Zhou authored Sep 18, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  c34f945b
- chore: debugger / debugging rust code (#2813) · 782ce578
  Elyas Mehtabuddin authored Sep 18, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
```
  782ce578
- chore: add codeowners for recipes folder (#3121) · 964fa639
  Hongkuan Zhou authored Sep 18, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  964fa639
- feat: add finish reason = tool_calls for stream=False and phi-4 detect token start fix (#3087) · 31f5ed3c
  Elyas Mehtabuddin authored Sep 18, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
```
  31f5ed3c
- fix: crates.io allows at most 5 keywords (#3122) · ef6734d0
  Harrison Saturley-Hall authored Sep 18, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  ef6734d0
- fix: incorrect crate SPDX identifier, Apache-2.0 (#3118) · dcf55c3c
  Harrison Saturley-Hall authored Sep 18, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  dcf55c3c
- fix: Define HF_HOME to be a mounted/cleaned dir (#3116) · e9cb9428
  Dillon Cullinan authored Sep 18, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  e9cb9428
- fix: add jq to sglang-wideep docker image (#3091) · 1b3eed4b
  Hongkuan Zhou authored Sep 18, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  1b3eed4b
- chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
  Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b6595e24
- docs: Emphasize Release Assets in docs: updating the landing page repo link to... · 6dd33261
  Kristen Kelleher authored Sep 17, 2025
```
docs: Emphasize Release Assets in docs: updating the landing page repo link to point to latest (#3097)
Signed-off-by: Kristen Kelleher <kkelleher@nvidia.com>
```
  6dd33261
- chore: set default tool calling behaviour to be disabled (#3096) · 37322011
  Ayush Agarwal authored Sep 17, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  37322011
17 Sep, 2025 14 commits
- chore: reorder dynamo_check.py output (very minor) (#3081) · d05795f2
  Keiven C authored Sep 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  d05795f2
- fix: Update the KVBM <> TRT-LLM integration interface to match the latest... · 86ce03f4
  Richard Huo authored Sep 17, 2025
```
fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  86ce03f4
- fix: harmony parser streaming fix (#3074) · cd814377
  Ayush Agarwal authored Sep 17, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  cd814377
- fix: hook up worker removals for indexer (#3095) · 78a3feda
  Yan Ru Pei authored Sep 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  78a3feda
- feat: decouple existing benchmarking within docs (#3072) · 26889b09
  hhzhang16 authored Sep 17, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  26889b09
- feat: Trtllm canary health check (#3082) · 67ff181d
  Tzu-Ling Kan authored Sep 17, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
```
  67ff181d
- chore(bindings): Remove NatsQueue (#3086) · f88d7dc7
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f88d7dc7
- chore: fillout sampling params (seed, n, best_of, min_p) (#3055) · 3de04dd9
  Greg Clark authored Sep 17, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  3de04dd9
- fix: update golang container to remove CVE (#3088) · e2c0e8d1
  Harrison Saturley-Hall authored Sep 17, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  e2c0e8d1
- fix: fix some trtllm tests (#3084) · 002617a9
  Richard Huo authored Sep 17, 2025
  
  002617a9
- feat: add chat_template_kwargs param to v1/chat/completion (#3016) · eb6722e3
  Chi McIsaac authored Sep 17, 2025
```
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
```
  eb6722e3
- feat: Make part of discovery re-usable (#3073) · 9060ce12
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9060ce12
- fix: resolve token loss bug in final packet (#2985) · 045b61dd
  Xuwei authored Sep 17, 2025
```
Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>
```
  045b61dd
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1