Commits · 419e936a53193ab57cb27a6052cb1a6823aea43f · OpenDAS / dynamo

09 Mar, 2026 2 commits

fix: increase process group termination timeout from 2s to 8s (#7132) · df67ce16

Yuewei Na authored Mar 09, 2026


Signed-off-by: Yuewei Na <yna@nvidia.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

df67ce16

fix: snapshot children before process group kill to prevent GPU memory leaks (#7122) · fddbb84d

Yuewei Na authored Mar 09, 2026


Signed-off-by: Yuewei Na <yna@nvidia.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

fddbb84d

02 Mar, 2026 1 commit
- fix: mypy type fixes (#6730) · e7f3361e
  Tzu-Ling Kan authored Mar 02, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  e7f3361e
18 Feb, 2026 2 commits

feat: add Anthropic Messages API endpoint (/v1/messages) (#6231) · b6603d90

ishandhanani authored Feb 18, 2026


Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Matej Kosec <mkosec@nvidia.com>

b6603d90

test: relocate test output to /tmp to keep git working tree clean (#6289) · d86937f9
Alec authored Feb 17, 2026
```
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
d86937f9

12 Feb, 2026 1 commit
- feat: responses API compliance with upstream type alignment (#6089) · 8cb47d04
  MatejKosec authored Feb 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  8cb47d04
11 Feb, 2026 1 commit
- feat: add Prometheus auto and custom label injection for engine metrics (#5989) · e18840ce
  Keiven C authored Feb 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  e18840ce
10 Feb, 2026 1 commit
- feat: expose Python Prometheus metric via DynamoComponentMetrics (#5817) · 027d2653
  Keiven C authored Feb 09, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  027d2653
06 Feb, 2026 2 commits
- ci: Transition deploy tests to pytest framework (#5874) · 6401e34d
  Tushar Sharma authored Feb 06, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  6401e34d
- refactor: Move --migration-limit flag from backend to frontend (#5918) · 1ffa489e
  Jacky authored Feb 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  1ffa489e
04 Feb, 2026 1 commit

chore: rename terminate_existing to terminate_all_matching_processes (#5923) · e55ebec5

Keiven C authored Feb 04, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e55ebec5

31 Jan, 2026 1 commit
- fix: fix test process termination logic to properly trigger graceful shutdown (#5775) · aea57cae
  jh-nv authored Jan 30, 2026
  
  aea57cae
29 Jan, 2026 1 commit
- chore: consistently used the arc shared workers configs + CI flake fixes (#5707) · 584020f4
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  584020f4
28 Jan, 2026 1 commit

fix: correct SGLang metrics prefix from sglang_ to sglang: (#5701) · e5557803

Keiven C authored Jan 27, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e5557803

23 Jan, 2026 1 commit
- chore: nuke ForwardPassMetrics (#5531) · feb6d272
  Yan Ru Pei authored Jan 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb6d272
09 Jan, 2026 1 commit
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
04 Jan, 2026 1 commit
- fix: sglang metrics and prefill router fix (#5147) · 007c5b60
  ishandhanani authored Jan 04, 2026
  
  007c5b60
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
19 Dec, 2025 2 commits

refactor: frontend/test_vllm.py to use shared dynamic ports (#5013) · 28044799

Keiven C authored Dec 19, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

28044799

refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc

Keiven C authored Dec 18, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

c22280cc

18 Dec, 2025 2 commits

refactor: consolidate fault_tolerance DynamoFrontendProcess, add timeouts (#5008) · f10f5942

Keiven C authored Dec 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

f10f5942

refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5

Keiven C authored Dec 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

1b8869f5

16 Dec, 2025 1 commit

test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf

Keiven C authored Dec 16, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6da23fcf

11 Dec, 2025 2 commits
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- test: add dynamic port allocation for fault_tolerant test execution (#4835) · c6b440e4
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6b440e4
10 Dec, 2025 2 commits
- test: add ci tests for lora (agg and router) (#4817) · acab6367
  Biswa Panda authored Dec 10, 2025
  
  acab6367
- feat: Add logprobs support to vLLM backend (#4683) (#4697) · f57fd72f
  Aryan Bagade authored Dec 09, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f57fd72f
09 Dec, 2025 3 commits
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- feat: fault tolerance rolling upgrade test scenarios (#4558) · a473402f
  Thomas Montfort authored Dec 09, 2025
  
  a473402f
- fix: guided decoding params handling in vLLM (#4770) · 3e4b480b
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
```
  3e4b480b
06 Dec, 2025 1 commit
- test: add timeout markers to pytest.mark.gpu_1 serve tests (#4768) · 2472aa4a
  Keiven C authored Dec 05, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  2472aa4a
04 Dec, 2025 2 commits
- refactor: remove legacy NATS metrics and stats_handler (#4680) · 00b64ae0
  Keiven C authored Dec 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  00b64ae0
- test: Multimodal Tool Calling vLLM Test (#4663) · 0651a4fe
  Indrajit Bhosale authored Dec 03, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0651a4fe
21 Nov, 2025 1 commit

ci: Testing b64 multimodal support with real image (#4280) · e7544f19

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

e7544f19

20 Nov, 2025 1 commit
- fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  75bf7c9b
19 Nov, 2025 1 commit
- ci: TRT-LLM multimodal CI (#4118) · a8e5328e
  Indrajit Bhosale authored Nov 19, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  a8e5328e
13 Nov, 2025 1 commit

refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c

Keiven C authored Nov 13, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

381c428c

07 Nov, 2025 2 commits
- feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) · 6bccf099
  Keiven C authored Nov 07, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6bccf099
- ci: Add Fault Tolerance K8s test (#3801) · d1cf3c2c
  Indrajit Bhosale authored Nov 07, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  d1cf3c2c
04 Nov, 2025 1 commit
- fix: add prefill metrics support for SGLang disaggregated mode (#3992) · 49ecfe60
  Keiven C authored Nov 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  49ecfe60