Commits · f4cd71f388d2490bb14b4e3701fead85ac8d4e94 · OpenDAS / dynamo

"components/vscode:/vscode.git/clone" did not exist on "b6595e24846dcf6674a16ecfd68241132e91abb3"

16 Oct, 2025 14 commits
- docs: move SGLang and vLLM Prometheus metrics documentation to docs path (#3677) · f4cd71f3
  Keiven C authored Oct 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f4cd71f3
- feat: add test metrics upload (#3648) · 1ddb62b4
  nv-nmailhot authored Oct 16, 2025
```
Signed-off-by: nv-nmailhot <nmailhot@nvidia.com>
```
  1ddb62b4
- test: add durable consumer count test to CI using py-nats (#3669) · fdcc8d5b
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fdcc8d5b
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
- ci: OPS-980: Add operator build and push per-commit (#3620) · 2f793b45
  Dillon Cullinan authored Oct 16, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  2f793b45
- feat: Replace genai-perf with aiperf (#3533) · 9f310225
  Harshini Komali authored Oct 16, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  9f310225
- fix: handling 0 block transfer (#3613) · 1972f71f
  Olga Andreeva authored Oct 16, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  1972f71f
- chore: move worker_monitor to the llm crate (#3667) · 7aa8e0e6
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7aa8e0e6
- fix: copy commit info in trtllm build (#3619) · 3d7f7a56
  Anant Sharma authored Oct 16, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3d7f7a56
- fix: add `--host` to k8s and bump sgl version (#3666) · 9a002b30
  ishandhanani authored Oct 15, 2025
  
  9a002b30
- test: add tool calling and reasoning tests for frontend on GPT-OSS (#3636) · ea07d51f
  zhongdaor-nv authored Oct 15, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  ea07d51f
- fix: mocker engines should ignore downloading weights from hf (again) (#3664) · ae4e96a2
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ae4e96a2
- feat: Enable cancellation during or before a stream is established (#3635) · 734d2f87
  Jacky authored Oct 15, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  734d2f87
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
15 Oct, 2025 11 commits
- fix: Reduce memory usage to avoid vLLM dsr1 OOM (#3660) · 29f5b822
  Kris Hung authored Oct 15, 2025
  
  29f5b822
- chore: Mark NIXL as beta in TRTLLM (#3633) · 43d687e8
  Tanmay Verma authored Oct 15, 2025
```
Signed-off-by: Laikh Tewari <ltewari@nvidia.com>
Co-authored-by: Laikh Tewari <ltewari@nvidia.com>
```
  43d687e8
- feat: Replace genai-perf with aiperf in components/backends (#3528) · a7badb85
  Harshini Komali authored Oct 15, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  a7badb85
- fix: update model recipe for llama-3 70b to match with common recipe template (#3637) · 13fc3c65
  Biswa Panda authored Oct 15, 2025
  
  13fc3c65
- feat: Streamline GAIE deployment (blackbox is still available with a simple flag) (#3591) · 15a01f75
  atchernych authored Oct 15, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15a01f75
- feat: vllm data parallelism multi-node support in operator (#3595) · 8388e162
  Thomas Montfort authored Oct 15, 2025
  
  8388e162
- fix: avoid offload redundant prefill blocks | fix cuda graph hanging (#3632) · f5854e17
  Ziqi Fan authored Oct 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  f5854e17
- fix: aarch64 path to use cu129 (#3624) · a6ac22e6
  Alec authored Oct 15, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  a6ac22e6
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
- feat: router frees request from slot manager on stopped requests (#3623) · 6a1391eb
  Yan Ru Pei authored Oct 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6a1391eb
- feat: support yaml config input for pre-deployment sweep script (#3622) · 400dceae
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  400dceae
14 Oct, 2025 15 commits
- chore: update sglang to 0.5.3.post1 to take advantage of container + doc cleanup (#3621) · c6e3db5e
  ishandhanani authored Oct 14, 2025
  
  c6e3db5e
- chore: separate config modifier into multiple files (#3627) · f26d8da7
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f26d8da7
- chore: Improve NATS connection error message (#3612) · caaea7ad
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  caaea7ad
- docs: add gpu details for model recipes (#3594) · e5f13356
  Biswa Panda authored Oct 14, 2025
  
  e5f13356
- chore: typo and new commands (#3617) · 4c4130e3
  ishandhanani authored Oct 14, 2025
  
  4c4130e3
- docs: Adding MDC to glossary (#3616) · 5744548b
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Kristen Kelleher <kkelleher@nvidia.com>
```
  5744548b
- fix: Add support for single element arrays for chat and completions prompts (#3482) · 3dc25129
  zhongdaor-nv authored Oct 14, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  3dc25129
- feat: catch Trtllm engine exceptions (#3544) · 1ad2a3b8
  Tzu-Ling Kan authored Oct 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1ad2a3b8
- docs: Add deprecation notices for unused Docker build arguments (no code change at all) (#3568) · 5cbfc27e
  Keiven C authored Oct 14, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  5cbfc27e
- ci: Pass CLI Arguments to workers with a pytest fixture (#3605) · 4a55fa99
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  4a55fa99
- feat: move the EPP build docker file (#3555) · fa1d6517
  atchernych authored Oct 14, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  fa1d6517
- test: Break parsers -> llm dependency (#3607) · 972adc37
  Graham King authored Oct 14, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  972adc37
- fix: only log config on `debug` log level, fix trtllm warnings (#3590) · 7b0fad3f
  William Arnold authored Oct 14, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  7b0fad3f
- feat: add pre-deployment check for storageclass (#3573) · 9bb2bc93
  Biswa Panda authored Oct 13, 2025
  
  9bb2bc93
- feat: update benchmarking script to use aiperf (#3306) · de3ca70b
  Biswa Panda authored Oct 13, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: lkomali <lkomali@nvidia.com>
Co-authored-by: lkomali <lkomali@nvidia.com>
Co-authored-by: Harshini Komali <157742537+lkomali@users.noreply.github.com>
```
  de3ca70b