Commits · f57fd72f8854bc91e2bf869cdd6bad4620b97ee8 · OpenDAS / dynamo

10 Dec, 2025 1 commit

feat: Add logprobs support to vLLM backend (#4683) (#4697) · f57fd72f

Aryan Bagade authored Dec 09, 2025


Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

f57fd72f

09 Dec, 2025 2 commits
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- fix: guided decoding params handling in vLLM (#4770) · 3e4b480b
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
```
  3e4b480b
08 Dec, 2025 2 commits

fix: increase timeout for test_{sglang,vllm,trtllm} model download time (#4792) · 300e5d55

Keiven C authored Dec 08, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

300e5d55

ci: fix login for operator job and other sgl/trtllm tests (#4785) · 1645884d

Dillon Cullinan authored Dec 08, 2025


Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

1645884d

06 Dec, 2025 1 commit
- test: add timeout markers to pytest.mark.gpu_1 serve tests (#4768) · 2472aa4a
  Keiven C authored Dec 05, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  2472aa4a
04 Dec, 2025 1 commit

test: Multimodal Tool Calling vLLM Test (#4663) · 0651a4fe

Indrajit Bhosale authored Dec 03, 2025


Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

0651a4fe

03 Dec, 2025 2 commits
- fix: enable LMCache metrics visibility with PROMETHEUS_MULTIPROC_DIR (#4654) · c6555852
  Keiven C authored Dec 02, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6555852
- test: bring back the framework 1 gpu pre-merge tests + clean up pytest markers (#4698) · 7e499b5c
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e499b5c
02 Dec, 2025 4 commits
- fix: Update expected prompt for deepep test (#4704) · af9ae793
  Kris Hung authored Dec 02, 2025
  
  af9ae793
- feat: Adding --dyn-endpoint-types flag (#4619) · 03070fd5
  KrishnanPrash authored Dec 02, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
```
  03070fd5
- fix: pin sniffio dependency (#4665) · 9fb5f03a
  Biswa Panda authored Dec 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  9fb5f03a
- ci: Remove the function level gpu config mark and update the markers in Dynamo... · fb4432e1
  Pavithra Vijayakrishnan authored Dec 01, 2025
```
ci: Remove the function level gpu config mark and update the markers in Dynamo pre-merge workflow (#4682)
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  fb4432e1
01 Dec, 2025 2 commits

test: fix trtllm config type in serve tests (#4670) · eb4bf9ab
Anant Sharma authored Dec 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
eb4bf9ab

test: Add pytest markers (#4111) · 0f6dca6e

Pavithra Vijayakrishnan authored Dec 01, 2025


Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>

0f6dca6e

25 Nov, 2025 1 commit
- feat: allow dynamic port in scripts in preparation for parallel testing (part 1) (#4546) · a77558d4
  Keiven C authored Nov 25, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  a77558d4
21 Nov, 2025 1 commit

ci: Testing b64 multimodal support with real image (#4280) · e7544f19

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

e7544f19

20 Nov, 2025 2 commits

fix: Support for msg[content] as a list (#4485) · 6767559f

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

6767559f

fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
75bf7c9b

19 Nov, 2025 2 commits
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- ci: TRT-LLM multimodal CI (#4118) · a8e5328e
  Indrajit Bhosale authored Nov 19, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  a8e5328e
18 Nov, 2025 1 commit

docs: Clean up incomplete recipes and clarify Kubernetes-only focus (#4159) · 88dfd1b3

Ben Hamm authored Nov 17, 2025


Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: atchernych <atchernych@nvidia.com>

88dfd1b3

17 Nov, 2025 1 commit

refactor: centralize environment variable constants (#4083) · 0e77d344

Keiven C authored Nov 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

0e77d344

13 Nov, 2025 2 commits
- feat: Add vLLM multimodal audio support (#2760) · 0f5dd2b7
  Yuekai Zhang authored Nov 14, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  0f5dd2b7
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
07 Nov, 2025 1 commit

feat: add parallelization filters (#4144) · 7750ed1a

Hongkuan Zhou authored Nov 07, 2025

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

7750ed1a

06 Nov, 2025 1 commit
- feat: Add base64 and HTTP image URL support to vLLM workers (#4114) · b73c571f
  KrishnanPrash authored Nov 05, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b73c571f
04 Nov, 2025 2 commits
- fix: add prefill metrics support for TensorRT-LLM disaggregated mode (#3983) · ba51c683
  Keiven C authored Nov 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  ba51c683
- fix: add prefill metrics support for SGLang disaggregated mode (#3992) · 49ecfe60
  Keiven C authored Nov 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  49ecfe60
31 Oct, 2025 2 commits
- chore: KVBM pip wheel (#3826) · 6afa679c
  Richard Huo authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  6afa679c
- refactor: move backend deploy, launch and slurm files from components to examples (#3849) · 8bd37c96
  Anant Sharma authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8bd37c96
29 Oct, 2025 1 commit
- feat: refactor vllm multimodal example (#3634) · 52090e2e
  Ayush Agarwal authored Oct 29, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  52090e2e
27 Oct, 2025 1 commit
- refactor: remove hardcoded /workspace paths across tests (#3888) · 07cf0744
  Keiven C authored Oct 27, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  07cf0744
24 Oct, 2025 1 commit
- feat: TensorRT-LLM and SGLang metrics validation (part 2/3 + 3/3) (#3842) · 3e015595
  Keiven C authored Oct 23, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3e015595
23 Oct, 2025 1 commit
- test: fix KV Router and KVBM tests in CI (#3848) · 5f98e91e
  Richard Huo authored Oct 23, 2025
  
  5f98e91e
22 Oct, 2025 1 commit
- test: add backend-specific metrics validation for E2E tests (part 1/3, vLLM only) (#3804) · bdef0ec5
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bdef0ec5
16 Oct, 2025 1 commit
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
10 Oct, 2025 2 commits
- feat: Sglang Request cancellation (#3465) · 2d0dab74
  Indrajit Bhosale authored Oct 10, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  2d0dab74
- test: Update multimodal sglang response validation to be more consistent (#3552) · a90ada15
  Ryan McCormick authored Oct 10, 2025
  
  a90ada15