Commits · 77a0051a6eb88992df785e1d112a5672ca6ff5fd · OpenDAS / dynamo

21 Apr, 2026 1 commit

fix: Delete SQL tool call test for now since small models could occasionally... · 77a0051a

Richard Huo authored Apr 21, 2026

fix: Delete SQL tool call test for now since small models could occasionally generate malformed arguments with guided decoding (#8474)

77a0051a

20 Apr, 2026 1 commit
- fix: update the tool calling functionalities for sglang frontend processor to... · 8fd7de9a
  Richard Huo authored Apr 20, 2026
```
fix: update the tool calling functionalities for sglang frontend processor to match with the latest sglang implementation (#8269)
```
  8fd7de9a
14 Apr, 2026 1 commit
- feat: remove enable_nats usage (#7265) · af0ff07c
  Biswa Panda authored Apr 14, 2026
  
  af0ff07c
07 Apr, 2026 1 commit
- test: e2e JSONL log verification for request tracing (#7817) · 73f8557a
  Neelay Shah authored Apr 07, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  73f8557a
03 Apr, 2026 1 commit
- fix: minor fixes (test parser, verbose flags, and adding comments to clarify gpu_1 usage) (#7841) · 5bd30719
  Keiven C authored Apr 03, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  5bd30719
02 Apr, 2026 1 commit
- feat: GPU-parallel test runner with VRAM-aware scheduling (#7560) · 6dc85fbc
  Keiven C authored Apr 02, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  6dc85fbc
18 Mar, 2026 1 commit

feat: GPU VRAM profiler via memory fraction injection + profiled test markers... · 0b20745e

Keiven C authored Mar 18, 2026


feat: GPU VRAM profiler via memory fraction injection + profiled test markers (part 2 - vLLM only) (#6719)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

0b20745e

13 Mar, 2026 1 commit
- chore(deps): bump vLLM 0.16.0 → 0.17.1 (#7170) · dba69e0f
  Tzu-Ling Kan authored Mar 12, 2026
```
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
```
  dba69e0f
11 Mar, 2026 2 commits
- test: pytests able to run locally now (#7219) · 4bd6299b
  Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4bd6299b
- test(frontend): Minimal integration test for vllm processor (#7173) · fda022b1
  Graham King authored Mar 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fda022b1
10 Mar, 2026 1 commit
- feat: split monolithic requirements.txt and remove test deps from runtime image (#6656) · 3cebc864
  Anant Sharma authored Mar 10, 2026
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  3cebc864
04 Mar, 2026 1 commit
- fix(frontend): vllm processor works with stream_interval > 1 (#6816) · 4e1bd700
  Graham King authored Mar 04, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e1bd700
01 Mar, 2026 1 commit
- chore: fix post merge (#6704) · 1412e44b
  Dmitry Tokarev authored Mar 01, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  1412e44b
24 Feb, 2026 1 commit

feat: remove --connector flag for vLLM backend (LLM-90) (#6450) · 6d3b92f0

Alec authored Feb 24, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

6d3b92f0

19 Feb, 2026 1 commit
- feat: Add runtime.endpoint() method to eliminate namespace chaining (#6386) · 0ce3461a
  Tzu-Ling Kan authored Feb 19, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  0ce3461a
13 Feb, 2026 2 commits
- Rename fetch_llm to fetch_model (#6268) · 5624d144
  Tzu-Ling Kan authored Feb 13, 2026
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  5624d144
- fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167) · a289695c
  mohammedabdulwahhab authored Feb 13, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  a289695c
04 Feb, 2026 1 commit

chore: rename terminate_existing to terminate_all_matching_processes (#5923) · e55ebec5

Keiven C authored Feb 04, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e55ebec5

20 Jan, 2026 1 commit
- test: Auto-start services for prompt_embed_tests.py (#5491) · e076f3a2
  Graham King authored Jan 20, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e076f3a2
09 Jan, 2026 1 commit

fix: KServe propagate error to client in stream infer (#5263) · bb8eaa23

GuanLuo authored Jan 08, 2026


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

bb8eaa23

08 Jan, 2026 1 commit
- feat(vllm): Add prompt embeds support for pre-computed inference inputs (#4739) · 6f9619a2
  Wenqi Glantz authored Jan 08, 2026
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  6f9619a2
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
19 Dec, 2025 2 commits

refactor: frontend/test_vllm.py to use shared dynamic ports (#5013) · 28044799

Keiven C authored Dec 19, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

28044799

refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc

Keiven C authored Dec 18, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

c22280cc

11 Dec, 2025 1 commit
- test: remove pytest_runtestloop (#4886) · d0e95c39
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d0e95c39
04 Dec, 2025 1 commit
- fix: skip HuggingFace download for non-llms (#4686) · 118323f2
  Neal Vaidya authored Dec 04, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  118323f2
03 Dec, 2025 2 commits
- feat: add Kserve readiness endpoint support: ServerLive / ServerReady / ModelReady (#4708) · d90dc39d
  GuanLuo authored Dec 03, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  d90dc39d
- test: bring back the framework 1 gpu pre-merge tests + clean up pytest markers (#4698) · 7e499b5c
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7e499b5c
01 Dec, 2025 1 commit

test: Add pytest markers (#4111) · 0f6dca6e

Pavithra Vijayakrishnan authored Dec 01, 2025


Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>

0f6dca6e

20 Nov, 2025 1 commit
- test: Router CI tests with vLLM engine (#3948) · d461631b
  Karen Chung authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  d461631b
19 Nov, 2025 1 commit
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
13 Nov, 2025 1 commit
- test(key_value_store): Assert entries() works correctly (#4312) · 58da7cfe
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  58da7cfe
11 Nov, 2025 1 commit
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
07 Nov, 2025 2 commits

feat: enable HTTP completion endpoint to accept arrays of prompts and generate... · 93ada899

zhongdaor-nv authored Nov 07, 2025


feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

93ada899

feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) · 6bccf099

Keiven C authored Nov 07, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

6bccf099

30 Oct, 2025 1 commit

feat: allow Triton model config specification in TensorModelConfig (#3874) · eb3a486d

GuanLuo authored Oct 31, 2025


Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

eb3a486d

27 Oct, 2025 1 commit
- test: fix frontend tests to make sure openai/gpt-oss-20b can be loaded on A100 (#3889) · 0d07e2c3
  Richard Huo authored Oct 27, 2025
  
  0d07e2c3
24 Oct, 2025 1 commit

feat: Extend TensorRequest and TensorResponse to contains extra parameters (#3761) · 90caf3ea

KrishnanPrash authored Oct 24, 2025

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

90caf3ea

22 Oct, 2025 1 commit

fix: enhance gRPC frontend to return output in raw content field for Triton... · d68e4b8a

GuanLuo authored Oct 22, 2025

fix: enhance gRPC frontend to return output in raw content field for Triton client compatibility (#3600)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>

d68e4b8a

16 Oct, 2025 1 commit

test: add tool calling and reasoning tests for frontend on GPT-OSS (#3636) · ea07d51f

zhongdaor-nv authored Oct 15, 2025

Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

ea07d51f