Commits · 0b20745edf3cb31f9294b5570a2f17ff2af3ea4d · OpenDAS / dynamo

18 Mar, 2026 1 commit

feat: GPU VRAM profiler via memory fraction injection + profiled test markers... · 0b20745e

Keiven C authored Mar 18, 2026


feat: GPU VRAM profiler via memory fraction injection + profiled test markers (part 2 - vLLM only) (#6719)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

0b20745e

16 Mar, 2026 1 commit
- test(router): reserve contiguous zmq ports (#7448) · c5ad4a87
  Yan Ru Pei authored Mar 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c5ad4a87
15 Mar, 2026 1 commit
- feat(kv-indexer): add python launcher follow-up [DYN-2459] (#7395) · 56b448a6
  Yan Ru Pei authored Mar 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  56b448a6
13 Mar, 2026 2 commits
- fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) · 947939c7
  Biswa Panda authored Mar 13, 2026
  
  947939c7
- feat: harden ManagedProcess teardown, add xdist-safe tests (#6670) · 608405e0
  Keiven C authored Mar 13, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  608405e0
11 Mar, 2026 2 commits
- test: pytests able to run locally now (#7219) · 4bd6299b
  Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4bd6299b
- fix: Fix mocker+router segfaults + reliability fixes (#7162) · 761e848b
  jthomson04 authored Mar 10, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  761e848b
10 Mar, 2026 1 commit
- fix(ft-tests): avoid shlex.split corrupting JSON args in ServiceSpec setters (#7012) · 6945d47e
  Tzu-Ling Kan authored Mar 09, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  6945d47e
09 Mar, 2026 2 commits

fix: increase process group termination timeout from 2s to 8s (#7132) · df67ce16

Yuewei Na authored Mar 09, 2026


Signed-off-by: Yuewei Na <yna@nvidia.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

df67ce16

fix: snapshot children before process group kill to prevent GPU memory leaks (#7122) · fddbb84d

Yuewei Na authored Mar 09, 2026


Signed-off-by: Yuewei Na <yna@nvidia.com>
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>

fddbb84d

02 Mar, 2026 1 commit
- fix: mypy type fixes (#6730) · e7f3361e
  Tzu-Ling Kan authored Mar 02, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  e7f3361e
18 Feb, 2026 2 commits

feat: add Anthropic Messages API endpoint (/v1/messages) (#6231) · b6603d90

ishandhanani authored Feb 18, 2026


Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Matej Kosec <mkosec@nvidia.com>

b6603d90

test: relocate test output to /tmp to keep git working tree clean (#6289) · d86937f9
Alec authored Feb 17, 2026
```
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
d86937f9

12 Feb, 2026 1 commit
- feat: responses API compliance with upstream type alignment (#6089) · 8cb47d04
  MatejKosec authored Feb 11, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  8cb47d04
11 Feb, 2026 1 commit
- feat: add Prometheus auto and custom label injection for engine metrics (#5989) · e18840ce
  Keiven C authored Feb 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  e18840ce
10 Feb, 2026 1 commit
- feat: expose Python Prometheus metric via DynamoComponentMetrics (#5817) · 027d2653
  Keiven C authored Feb 09, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  027d2653
06 Feb, 2026 2 commits
- ci: Transition deploy tests to pytest framework (#5874) · 6401e34d
  Tushar Sharma authored Feb 06, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  6401e34d
- refactor: Move --migration-limit flag from backend to frontend (#5918) · 1ffa489e
  Jacky authored Feb 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  1ffa489e
04 Feb, 2026 1 commit

chore: rename terminate_existing to terminate_all_matching_processes (#5923) · e55ebec5

Keiven C authored Feb 04, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e55ebec5

31 Jan, 2026 1 commit
- fix: fix test process termination logic to properly trigger graceful shutdown (#5775) · aea57cae
  jh-nv authored Jan 30, 2026
  
  aea57cae
29 Jan, 2026 1 commit
- chore: consistently used the arc shared workers configs + CI flake fixes (#5707) · 584020f4
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  584020f4
28 Jan, 2026 1 commit

fix: correct SGLang metrics prefix from sglang_ to sglang: (#5701) · e5557803

Keiven C authored Jan 27, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e5557803

23 Jan, 2026 1 commit
- chore: nuke ForwardPassMetrics (#5531) · feb6d272
  Yan Ru Pei authored Jan 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb6d272
09 Jan, 2026 1 commit
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
04 Jan, 2026 1 commit
- fix: sglang metrics and prefill router fix (#5147) · 007c5b60
  ishandhanani authored Jan 04, 2026
  
  007c5b60
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
19 Dec, 2025 2 commits

refactor: frontend/test_vllm.py to use shared dynamic ports (#5013) · 28044799

Keiven C authored Dec 19, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

28044799

refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc

Keiven C authored Dec 18, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

c22280cc

18 Dec, 2025 2 commits

refactor: consolidate fault_tolerance DynamoFrontendProcess, add timeouts (#5008) · f10f5942

Keiven C authored Dec 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

f10f5942

refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5

Keiven C authored Dec 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

1b8869f5

16 Dec, 2025 1 commit

test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf

Keiven C authored Dec 16, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6da23fcf

11 Dec, 2025 2 commits
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- test: add dynamic port allocation for fault_tolerant test execution (#4835) · c6b440e4
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6b440e4
10 Dec, 2025 2 commits
- test: add ci tests for lora (agg and router) (#4817) · acab6367
  Biswa Panda authored Dec 10, 2025
  
  acab6367
- feat: Add logprobs support to vLLM backend (#4683) (#4697) · f57fd72f
  Aryan Bagade authored Dec 09, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f57fd72f
09 Dec, 2025 3 commits
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- feat: fault tolerance rolling upgrade test scenarios (#4558) · a473402f
  Thomas Montfort authored Dec 09, 2025
  
  a473402f
- fix: guided decoding params handling in vLLM (#4770) · 3e4b480b
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
```
  3e4b480b
06 Dec, 2025 1 commit
- test: add timeout markers to pytest.mark.gpu_1 serve tests (#4768) · 2472aa4a
  Keiven C authored Dec 05, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  2472aa4a
04 Dec, 2025 1 commit
- refactor: remove legacy NATS metrics and stats_handler (#4680) · 00b64ae0
  Keiven C authored Dec 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  00b64ae0