Commits · 4d9e64a2c1f0250523a2c7b71e1f058ae97b445d · OpenDAS / dynamo

31 Jan, 2026 1 commit
- fix: fix test process termination logic to properly trigger graceful shutdown (#5775) · aea57cae
  jh-nv authored Jan 30, 2026
  
  aea57cae
29 Jan, 2026 1 commit
- chore: consistently used the arc shared workers configs + CI flake fixes (#5707) · 584020f4
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  584020f4
28 Jan, 2026 1 commit

fix: correct SGLang metrics prefix from sglang_ to sglang: (#5701) · e5557803

Keiven C authored Jan 27, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e5557803

23 Jan, 2026 1 commit
- chore: nuke ForwardPassMetrics (#5531) · feb6d272
  Yan Ru Pei authored Jan 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb6d272
09 Jan, 2026 1 commit
- fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237) · 0d3ff440
  Biswa Panda authored Jan 08, 2026
  
  0d3ff440
04 Jan, 2026 1 commit
- fix: sglang metrics and prefill router fix (#5147) · 007c5b60
  ishandhanani authored Jan 04, 2026
  
  007c5b60
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
19 Dec, 2025 2 commits

refactor: frontend/test_vllm.py to use shared dynamic ports (#5013) · 28044799

Keiven C authored Dec 19, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

28044799

refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc

Keiven C authored Dec 18, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

c22280cc

18 Dec, 2025 2 commits

refactor: consolidate fault_tolerance DynamoFrontendProcess, add timeouts (#5008) · f10f5942

Keiven C authored Dec 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

f10f5942

refactor: router tests to be pytest-xdist parallel safe (#5005) · 1b8869f5

Keiven C authored Dec 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

1b8869f5

16 Dec, 2025 1 commit

test: make serve tests xdist-safe with dynamic ports (#4951) · 6da23fcf

Keiven C authored Dec 16, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6da23fcf

11 Dec, 2025 2 commits
- fix: [lora] refactor test and clean up examples (#4884) · 3c2b72b0
  Biswa Panda authored Dec 11, 2025
  
  3c2b72b0
- test: add dynamic port allocation for fault_tolerant test execution (#4835) · c6b440e4
  Keiven C authored Dec 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c6b440e4
10 Dec, 2025 2 commits
- test: add ci tests for lora (agg and router) (#4817) · acab6367
  Biswa Panda authored Dec 10, 2025
  
  acab6367
- feat: Add logprobs support to vLLM backend (#4683) (#4697) · f57fd72f
  Aryan Bagade authored Dec 09, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f57fd72f
09 Dec, 2025 3 commits
- feat: Add logprobs support to TRTLLM backend (#4759) · 01bfbea1
  Elijah Soba authored Dec 09, 2025
```
Signed-off-by: Elijah Soba <esoba@nvidia.com>
```
  01bfbea1
- feat: fault tolerance rolling upgrade test scenarios (#4558) · a473402f
  Thomas Montfort authored Dec 09, 2025
  
  a473402f
- fix: guided decoding params handling in vLLM (#4770) · 3e4b480b
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Karen Chung <karenc@nvidia.com>
```
  3e4b480b
06 Dec, 2025 1 commit
- test: add timeout markers to pytest.mark.gpu_1 serve tests (#4768) · 2472aa4a
  Keiven C authored Dec 05, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  2472aa4a
04 Dec, 2025 2 commits
- refactor: remove legacy NATS metrics and stats_handler (#4680) · 00b64ae0
  Keiven C authored Dec 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  00b64ae0
- test: Multimodal Tool Calling vLLM Test (#4663) · 0651a4fe
  Indrajit Bhosale authored Dec 03, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0651a4fe
21 Nov, 2025 1 commit

ci: Testing b64 multimodal support with real image (#4280) · e7544f19

KrishnanPrash authored Nov 20, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

e7544f19

20 Nov, 2025 1 commit
- fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  75bf7c9b
19 Nov, 2025 1 commit
- ci: TRT-LLM multimodal CI (#4118) · a8e5328e
  Indrajit Bhosale authored Nov 19, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  a8e5328e
13 Nov, 2025 1 commit

refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) · 381c428c

Keiven C authored Nov 13, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

381c428c

07 Nov, 2025 2 commits
- feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) · 6bccf099
  Keiven C authored Nov 07, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6bccf099
- ci: Add Fault Tolerance K8s test (#3801) · d1cf3c2c
  Indrajit Bhosale authored Nov 07, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  d1cf3c2c
04 Nov, 2025 1 commit
- fix: add prefill metrics support for SGLang disaggregated mode (#3992) · 49ecfe60
  Keiven C authored Nov 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  49ecfe60
31 Oct, 2025 2 commits
- refactor: move backend deploy, launch and slurm files from components to examples (#3849) · 8bd37c96
  Anant Sharma authored Oct 31, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  8bd37c96
- feat: Add prompt > seq_len k8 tests. (#3930) · c4abe9bc
  Tzu-Ling Kan authored Oct 30, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  c4abe9bc
27 Oct, 2025 2 commits
- feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass... · 0028cdf4
  Kyle McGill authored Oct 27, 2025
```
feat: Use ForwardPassCallback api from TRTLLM to register end of forward pass callback to enable cuda graphs (#3297)
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>
```
  0028cdf4
- refactor: remove hardcoded /workspace paths across tests (#3888) · 07cf0744
  Keiven C authored Oct 27, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  07cf0744
24 Oct, 2025 1 commit
- feat: TensorRT-LLM and SGLang metrics validation (part 2/3 + 3/3) (#3842) · 3e015595
  Keiven C authored Oct 23, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3e015595
22 Oct, 2025 1 commit
- test: add backend-specific metrics validation for E2E tests (part 1/3, vLLM only) (#3804) · bdef0ec5
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  bdef0ec5
10 Oct, 2025 1 commit
- feat: add Rust-to-Python const code generator for prometheus_names.py (#3425) · f2ba58e5
  Keiven C authored Oct 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f2ba58e5
09 Oct, 2025 1 commit
- feat: changing SIGKILL to SIGINT for graceful shutdown (#3513) · cdfd70f0
  Tzu-Ling Kan authored Oct 08, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  cdfd70f0
07 Oct, 2025 2 commits
- chore: add e2e test for reasoning_effort for gpt-oss model (#3421) · 89e7dab2
  zhongdaor-nv authored Oct 07, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  89e7dab2
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
03 Oct, 2025 1 commit
- test: TRTLLM K8s FT tests (#3368) · 031dc589
  Indrajit Bhosale authored Oct 02, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  031dc589