Commits · 2887cd1ce052df20d2e4e0109ad74d2074164cfd · OpenDAS / dynamo

30 Mar, 2026 1 commit
- refactor(1/3): move `nvext` to `dynamo-llm` and move `anthropic` to `dynamo-async-openai` (#7564) · 2887cd1c
  ishandhanani authored Mar 30, 2026
  
  2887cd1c
13 Mar, 2026 1 commit
- fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) · 947939c7
  Biswa Panda authored Mar 13, 2026
  
  947939c7
26 Feb, 2026 1 commit
- feat: enable returning routed experts info up through sglang (#6137) · 4960dbb3
  William Arnold authored Feb 25, 2026
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  4960dbb3
11 Feb, 2026 1 commit
- feat: add router-level Prometheus metrics and centralize request tracking (#6146) · f46720c9
  Yan Ru Pei authored Feb 10, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  f46720c9
09 Feb, 2026 1 commit
- feat: text to image vLLM Omni (#5912) · 9f76d060
  Ayush Agarwal authored Feb 09, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  9f76d060
04 Feb, 2026 1 commit
- feat: Add per-worker Prometheus metrics for router load monitoring (#5842) · 0c0336e6
  Hongkuan Zhou authored Feb 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  0c0336e6
08 Jan, 2026 1 commit
- feat(vllm): Add prompt embeds support for pre-computed inference inputs (#4739) · 6f9619a2
  Wenqi Glantz authored Jan 08, 2026
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  6f9619a2
03 Jan, 2026 1 commit
- feat: add continuous_usage_stats option for per-chunk usage (#5139) · 6bfb41de
  GuanLuo authored Jan 03, 2026
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  6bfb41de
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
19 Dec, 2025 1 commit
- feat: Runtime media decoder config (#5011) · d2faf0e6
  milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  d2faf0e6
18 Dec, 2025 2 commits
- feat: unify per-request metric tracking (#5004) · 85b5c808
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  85b5c808
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
13 Dec, 2025 1 commit
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
11 Dec, 2025 2 commits

feat: add cached tokens prometheus metric (#4534) · f8bb53c0

Vladislav Nosivskoy authored Dec 11, 2025


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

f8bb53c0

feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f

Yan Ru Pei authored Dec 10, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>

2845aa1f

09 Dec, 2025 1 commit
- chore: cleanups of passing around prefill and decode worker ids (#4829) · 1e5b20b2
  Yan Ru Pei authored Dec 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1e5b20b2
19 Nov, 2025 1 commit
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
18 Nov, 2025 1 commit
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
03 Nov, 2025 1 commit
- feat: Reject unsupported parameters with 400 Bad Request (#4021) · c837b5ba
  KrishnanPrash authored Nov 03, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  c837b5ba
29 Oct, 2025 1 commit
- chore: add usage field to non-streaming responses by default (#3922) · 3fe5653b
  Ayush Agarwal authored Oct 29, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  3fe5653b
01 Oct, 2025 1 commit
- feat: reasoning parser transformation (#3295) · 2a2bf58a
  Ayush Agarwal authored Oct 01, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2a2bf58a
18 Sep, 2025 1 commit

feat: enhance GPT OSS frontend with improved harmony tool calling parser and... · 6675bfc8

zhongdaor-nv authored Sep 18, 2025


feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

6675bfc8

16 Sep, 2025 1 commit
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
09 Sep, 2025 1 commit
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
26 Aug, 2025 1 commit
- feat: align OpenAI response IDs with distributed trace IDs (#2496) · a485ab78
  Chi McIsaac authored Aug 26, 2025
  
  a485ab78
25 Aug, 2025 2 commits
- feat: enable --dyn-reasoning-parser flag to set reasoning parser for vllm deployments (#2700) · f5a41004
  nachiketb-nvidia authored Aug 25, 2025
  
  f5a41004
- feat: add gpt oss reasoning parser through harmony (#2656) · 3036e60b
  nachiketb-nvidia authored Aug 25, 2025
```
- couple of refactors
- added a new dependency, openai-harmony
- implemented the gpt oss parser
```
  3036e60b
21 Aug, 2025 2 commits
- feat: enable basic reasoning parsing of <think> </think> tokens (#2555) · 8e8152a1
  nachiketb-nvidia authored Aug 21, 2025
  
  8e8152a1
- chore: Remove Clone / Sync from DeltaGenerator (#2598) · 0c50a233
  Graham King authored Aug 21, 2025
  
  0c50a233
20 Aug, 2025 1 commit

chore: remove flatten for chat response types, add reasoning_content (#2543) · c12fe501

nachiketb-nvidia authored Aug 19, 2025

Changing the chat completions response objects from structs to types of dynamo_async_openai

Implement aggregator traits for them chat completion structs

add reasoning_content under message and delta message in lib/async-openai

c12fe501

19 Aug, 2025 1 commit
- chore: Bring async-openai into repo as request starter (#2520) · 199b9a30
  nachiketb-nvidia authored Aug 19, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  199b9a30
14 Aug, 2025 1 commit
- feat: logprob handling (#2426) · f476fd74
  Greg Clark authored Aug 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  f476fd74
09 Jul, 2025 1 commit
- feat: Support for unary tool use in ChatCompletions API (#1800) · 5e2f29f5
  Paul Hendricks authored Jul 09, 2025
  
  5e2f29f5
26 Jun, 2025 2 commits
- refactor: removing unsized integer conversions (#1668) · 8a2d6529
  Paul Hendricks authored Jun 26, 2025
  
  8a2d6529
- refactor: refactored using Choice and CompletionFinishReason (#1635) · 7b7b6a6d
  Paul Hendricks authored Jun 26, 2025
  
  7b7b6a6d
25 Jun, 2025 1 commit
- fix: fix usage.total_tokens count for OpenAI endpoints (#1649) · 6032c82f
  Zhongdongming Dai authored Jun 25, 2025
  
  6032c82f
03 Jun, 2025 1 commit

feat: add more metrics to rust frontend (#1315) · 98d4abbb

Hongkuan Zhou authored Jun 03, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: jothomson <jwillthomson19@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

98d4abbb

14 Mar, 2025 1 commit
- fix: Fix cargo doc warnings for lib/llm (#151) · dac63127
  Ryan McCormick authored Mar 14, 2025
  
  dac63127
27 Feb, 2025 2 commits
- refactor: removes wrapper for ChatCompletionContent and adds documentation (#296) · 151a2a1d
  Paul Hendricks authored Feb 27, 2025
  
  151a2a1d
- refactor: rename ChatCompletionResponseDelta to NvCreateChatCompletionStreamResponse (#292) · 110f3f8c
  Paul Hendricks authored Feb 27, 2025
  
  110f3f8c