Commits · a79122c6e06e03db993951f2c1e74ac65dd62d48 · OpenDAS / dynamo

27 Oct, 2025 21 commits

feat: Media URL passthrough in OAI preprocessor (#3733) · a79122c6
milesial authored Oct 27, 2025
```
Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
```
a79122c6
chore: update to match new gitlab config (#3925) · a34f52cf
Alec authored Oct 27, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
a34f52cf
feat: ETCD high availability client failover - lease keep-alive resilience (#3868) · 9b6c4f91
Jacky authored Oct 27, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
9b6c4f91
feat: Add CPU metrics to Grafana Dynamo Dashboard (#3908) · 9c5bdf83
Indrajit Bhosale authored Oct 27, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
9c5bdf83

feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass... · 0028cdf4

Kyle McGill authored Oct 27, 2025


feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass callback to enable cuda graphs (#3297)
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>

0028cdf4

fix: Update Broken Links (#3918) · cfc1e6ce
KrishnanPrash authored Oct 27, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
cfc1e6ce
chore: add request validation and better error message for n > 1 and temperature=0 (#3914) · 980bae03
zhongdaor-nv authored Oct 27, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
980bae03
chore: Update version to 0.6.1 (#3916) · 9bb1af33
Tushar Sharma authored Oct 27, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
9bb1af33

build: OPS-1140: Refactor sglang dockerfile to support wideep (#3792) · 7c74764b

Tushar Sharma authored Oct 27, 2025


Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Tzu-Ling Kan <tzulingk@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Rohan Varma <rohanv@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

7c74764b

feat: turn profiling k8s jobs into sample DGDR requests (#3864) · 6a84ffd3

hhzhang16 authored Oct 27, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

6a84ffd3

test: fix frontend tests to make sure openai/gpt-oss-20b can be loaded on A100 (#3889) · 0d07e2c3
Richard Huo authored Oct 27, 2025

0d07e2c3
feat: echo parameter validation for `/v1/completions` (#3813) · b4c8d948
KrishnanPrash authored Oct 27, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
b4c8d948

refactor: Dev Container (devcontainer) to standardize paths to /workspace (for... · 6739154d

Keiven C authored Oct 27, 2025


refactor: Dev Container (devcontainer) to standardize paths to /workspace (for pytest compatibility) (#3870)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

6739154d

fix: fix operator tests (#3904) · 6e213d90
Julien Mancuso authored Oct 27, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
6e213d90
test: Add request migration graceful shutdown E2E test (#3585) · 59535682
Jacky authored Oct 27, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
59535682
fix: pipe AI perf streaming output to terminal in rotuer benchmarking (#3905) · 8c8922b0
Yan Ru Pei authored Oct 27, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
8c8922b0
refactor: remove hardcoded /workspace paths across tests (#3888) · 07cf0744
Keiven C authored Oct 27, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
07cf0744
fix: consistent model recipes and update simplified doc (#3858) · 0757ecf1
Biswa Panda authored Oct 27, 2025

0757ecf1
docs: update version picker for 0.6.1 (#3906) · c2dc8557
Kristen Kelleher authored Oct 27, 2025

c2dc8557
fix(nats): NATs queue should use streaming API otherwise KV events drop (#3900) · 76d96bb0
Yan Ru Pei authored Oct 27, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
76d96bb0
chore(discovery): Use Store interface instead of etcd (#3887) · 5a0d710b
Graham King authored Oct 27, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
5a0d710b

25 Oct, 2025 1 commit
- fix: char boundary panic jail (#3893) · 6deeecb1
  ryan-lempka authored Oct 25, 2025
  
  6deeecb1
24 Oct, 2025 18 commits
- docs: initial trtllm recipe for qwen32b-fp8 (#3827) · 48b622c5
  Alec authored Oct 24, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  48b622c5
- fix: default when tools missing and minijinja length handling (#3880) · 818d72ae
  ryan-lempka authored Oct 24, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: ryan-lempka <rlempka@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  818d72ae
- fix: ignore stop key in vllm sampling params (#3879) · a79151c8
  ryan-lempka authored Oct 24, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  a79151c8
- fix: Fix sglang multimodal test (#3862) · 77cecf4e
  Kris Hung authored Oct 24, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  77cecf4e
- refactor: redesign the metrics API from Trait to composition to make the code... · cbe0b177
  Keiven C authored Oct 24, 2025
```
refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  cbe0b177
- ci: Try using docker driver instead of docker-container (#3824) · eb8d07cb
  Dillon Cullinan authored Oct 24, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  eb8d07cb
- chore: mocker states do not need arc mutex (#3883) · d870d4b0
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d870d4b0
- fix: add the proper flag for mooncake benchmarking on router (#3878) · ee275cbf
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ee275cbf
- feat: python binding for kserve grpc frontend (#3739) · 9e5407f2
  zhongdaor-nv authored Oct 24, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  9e5407f2
- chore: don't error on failure to download snapshot (#3871) · 8d0a5eba
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8d0a5eba
- refactor: move engine configs out of components directory (#3772) · 8354d325
  Anant Sharma authored Oct 24, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
```
  8354d325
- feat: Extend TensorRequest and TensorResponse to contains extra parameters (#3761) · 90caf3ea
  KrishnanPrash authored Oct 24, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  90caf3ea
- chore(runtime): Watched storage buckets now also return Delete events (#3875) · b77696da
  Graham King authored Oct 24, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b77696da
- feat(sglang): experimental gb200 fp4 and updated gb200 fp8 commands (#3745) · 9defc01b
  ishandhanani authored Oct 23, 2025
  
  9defc01b
- fix: test case test_endpoint_health_check_notifier_created (#3863) · 7c208309
  Tzu-Ling Kan authored Oct 23, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  7c208309
- feat: add nats sink for audit logging (#3732) · cb0a3449
  ryan-lempka authored Oct 23, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  cb0a3449
- feat: TensorRT-LLM and SGLang metrics validation (part 2/3 + 3/3) (#3842) · 3e015595
  Keiven C authored Oct 23, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3e015595
- fix: include request_id and error details in completions stream failure message (#3860) · 2f89c176
  zhongdaor-nv authored Oct 23, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  2f89c176