Commits · 8388e16280d96b2146df64a413779e23e4b18109 · OpenDAS / dynamo · GitLab

15 Oct, 2025 6 commits
- feat: vllm data parallelism multi-node support in operator (#3595) · 8388e162
  Thomas Montfort authored Oct 15, 2025
  
  8388e162
- fix: avoid offload redundant prefill blocks | fix cuda graph hanging (#3632) · f5854e17
  Ziqi Fan authored Oct 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  f5854e17
- fix: aarch64 path to use cu129 (#3624) · a6ac22e6
  Alec authored Oct 15, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  a6ac22e6
- feat: Python binding to download a model. (#3593) · ab0da582
  Graham King authored Oct 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ab0da582
- feat: router frees request from slot manager on stopped requests (#3623) · 6a1391eb
  Yan Ru Pei authored Oct 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6a1391eb
- feat: support yaml config input for pre-deployment sweep script (#3622) · 400dceae
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  400dceae
14 Oct, 2025 16 commits
- chore: update sglang to 0.5.3.post1 to take advantage of container + doc cleanup (#3621) · c6e3db5e
  ishandhanani authored Oct 14, 2025
  
  c6e3db5e
- chore: separate config modifier into multiple files (#3627) · f26d8da7
  Hongkuan Zhou authored Oct 14, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f26d8da7
- chore: Improve NATS connection error message (#3612) · caaea7ad
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  caaea7ad
- docs: add gpu details for model recipes (#3594) · e5f13356
  Biswa Panda authored Oct 14, 2025
  
  e5f13356
- chore: typo and new commands (#3617) · 4c4130e3
  ishandhanani authored Oct 14, 2025
  
  4c4130e3
- docs: Adding MDC to glossary (#3616) · 5744548b
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Kristen Kelleher <kkelleher@nvidia.com>
```
  5744548b
- fix: Add support for single element arrays for chat and completions prompts (#3482) · 3dc25129
  zhongdaor-nv authored Oct 14, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  3dc25129
- feat: catch Trtllm engine exceptions (#3544) · 1ad2a3b8
  Tzu-Ling Kan authored Oct 14, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1ad2a3b8
- docs: Add deprecation notices for unused Docker build arguments (no code change at all) (#3568) · 5cbfc27e
  Keiven C authored Oct 14, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  5cbfc27e
- ci: Pass CLI Arguments to workers with a pytest fixture (#3605) · 4a55fa99
  KrishnanPrash authored Oct 14, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  4a55fa99
- feat: move the EPP build docker file (#3555) · fa1d6517
  atchernych authored Oct 14, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  fa1d6517
- test: Break parsers -> llm dependency (#3607) · 972adc37
  Graham King authored Oct 14, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  972adc37
- fix: only log config on `debug` log level, fix trtllm warnings (#3590) · 7b0fad3f
  William Arnold authored Oct 14, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  7b0fad3f
- feat: add pre-deployment check for storageclass (#3573) · 9bb2bc93
  Biswa Panda authored Oct 13, 2025
  
  9bb2bc93
- feat: update benchmarking script to use aiperf (#3306) · de3ca70b
  Biswa Panda authored Oct 13, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: lkomali <lkomali@nvidia.com>
Co-authored-by: lkomali <lkomali@nvidia.com>
Co-authored-by: Harshini Komali <157742537+lkomali@users.noreply.github.com>
```
  de3ca70b
- fix: Fix vllm multimodal qwen cuda oom issue (#3598) · 9b0948c6
  Kris Hung authored Oct 13, 2025
  
  9b0948c6
13 Oct, 2025 11 commits
- chore: pre-0.6.0 activities (#3592) · cd2389ba
  Harrison Saturley-Hall authored Oct 13, 2025
```
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  cd2389ba
- fix: Improve Error Messaging for port/address already in use error (#3587) · fa4ce46c
  KrishnanPrash authored Oct 13, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  fa4ce46c
- feat: remove stale workers on snapshot + some refactoring (#3589) · b5e762b2
  Yan Ru Pei authored Oct 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b5e762b2
- feat: Metric histogram buckets configureable from env (#3562) · f0065bb4
  William Arnold authored Oct 13, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  f0065bb4
- docs: Fix typos and remove incomplete section from vllm multinode doc (#3588) · d4ff6f0a
  Ryan McCormick authored Oct 13, 2025
```
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
```
  d4ff6f0a
- feat: add and print container build metrics (#3461) · 8dd104d4
  nv-nmailhot authored Oct 13, 2025
  
  8dd104d4
- feat: OTEL Exporter and Tempo Visualization (#3307) · 1f92dd54
  mohammedabdulwahhab authored Oct 13, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1f92dd54
- fix: fix devcontainer build to work across shells (#3576) · 037cc35d
  Biswa Panda authored Oct 13, 2025
  
  037cc35d
- docs: Adding instruction to install python3-dev (#3554) · 855d9a95
  KrishnanPrash authored Oct 13, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  855d9a95
- chore: update for error messages (#3549) · 6337afec
  Neelay Shah authored Oct 13, 2025
  
  6337afec
- docs: removed all TODOs from public facing docs within repo (#3540) · 60ba7b25
  Maksim Khadkevich authored Oct 13, 2025
```
Signed-off-by: Maksim Khadkevich <mkhadkevich@nvidia.com>
```
  60ba7b25
12 Oct, 2025 1 commit
- chore: bump vllm to 0.11.0 (#3422) · 90dc7589
  Alec authored Oct 12, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  90dc7589
11 Oct, 2025 6 commits
- feat: improve CRD documentation (#3504) · 60975b51
  Julien Mancuso authored Oct 11, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  60975b51
- chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6
  Yan Ru Pei authored Oct 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  c3fcfdd6
- feat: implement custom backend metrics for NIM (#3266) · 65cc5337
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  65cc5337
- feat: rm the old KVBM metrics | update G2 to G3 metrics collection (#3561) · 4224e57d
  Ziqi Fan authored Oct 10, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  4224e57d
- feat: add SGLang and vLLM passthrough metrics on Dynamo backend worker (#3539) · 55e458d8
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  55e458d8
- fix: callback registration, fix metric name access, ensure ordered vec, etc... (#3541) · a4746ab6
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a4746ab6