Commits · 263f99dc8be40cf22e1843dcaedfa3d11c3a1604 · OpenDAS / dynamo

19 Nov, 2025 1 commit
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
18 Nov, 2025 1 commit
- feat: support prompt_tokens_details in usage (#4239) · be9d6b2b
  Vladislav Nosivskoy authored Nov 19, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  be9d6b2b
08 Nov, 2025 2 commits
- fix: no more multiple finish reasons in stream (#4154) · 04f7579b
  Ayush Agarwal authored Nov 07, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  04f7579b
- feat: Add support for skip_special_tokens parameter in v1/completions and... · 441473c3
  Ryan McCormick authored Nov 07, 2025
```
feat: Add support for skip_special_tokens parameter in v1/completions and v1/chat/completions endpoints (#4175)
```
  441473c3
07 Nov, 2025 2 commits
- feat: enable HTTP completion endpoint to accept arrays of prompts and generate... · 93ada899
  zhongdaor-nv authored Nov 07, 2025
```
feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  93ada899
- fix: Don't trim whitespace from end of each chat completion delta in aggregator (#4152) · f5094935
  Ryan McCormick authored Nov 06, 2025
  
  f5094935
06 Nov, 2025 2 commits
- fix: Remove constant gpt-2 token_id upper bound check (#3760) · 6336eea4
  Nathan Barry authored Nov 05, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6336eea4
- feat: Reject unsupported parameters with 400 Bad Request (`/v1/completions`) (#4140) · 3d036fc4
  KrishnanPrash authored Nov 05, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  3d036fc4
03 Nov, 2025 1 commit
- feat: Reject unsupported parameters with 400 Bad Request (#4021) · c837b5ba
  KrishnanPrash authored Nov 03, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  c837b5ba
29 Oct, 2025 1 commit
- chore: add usage field to non-streaming responses by default (#3922) · 3fe5653b
  Ayush Agarwal authored Oct 29, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  3fe5653b
27 Oct, 2025 1 commit
- chore: add request validation and better error message for n > 1 and temperature=0 (#3914) · 980bae03
  zhongdaor-nv authored Oct 27, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  980bae03
23 Oct, 2025 1 commit
- chore: Use KeyValueStoreManager instead of etcd::Client (#3822) · 7731b024
  Graham King authored Oct 23, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7731b024
10 Oct, 2025 1 commit
- chore: remove deprecated nvext parameters for 6.0 (#3551) · b954a249
  ryan-lempka authored Oct 10, 2025
  
  b954a249
01 Oct, 2025 1 commit
- feat: reasoning parser transformation (#3295) · 2a2bf58a
  Ayush Agarwal authored Oct 01, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2a2bf58a
29 Sep, 2025 2 commits
- chore: relaxing constraints on metadata field, adding metadata field to completions API (#3240) · 13156361
  nv-nedelman-1 authored Sep 29, 2025
```
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
```
  13156361
- feat: enable parallel tool calling and add testing (#3188) · 67e1f6ee
  Elyas Mehtabuddin authored Sep 29, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  67e1f6ee
26 Sep, 2025 1 commit
- chore: added more api error code validations (#3231) · d4f0d2bc
  Ayush Agarwal authored Sep 26, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d4f0d2bc
24 Sep, 2025 1 commit
- chore: jail stream optimizations (v1) (#3195) · 2ae20102
  Ayush Agarwal authored Sep 24, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2ae20102
23 Sep, 2025 1 commit
- feat: JailedStream (#3034) · c63cceaa
  Ryan Olson authored Sep 23, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c63cceaa
18 Sep, 2025 2 commits
- feat: enhance GPT OSS frontend with improved harmony tool calling parser and... · 6675bfc8
  zhongdaor-nv authored Sep 18, 2025
```
feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  6675bfc8
- feat: add finish reason = tool_calls for stream=False and phi-4 detect token start fix (#3087) · 31f5ed3c
  Elyas Mehtabuddin authored Sep 18, 2025
```
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
```
  31f5ed3c
17 Sep, 2025 2 commits
- chore: fillout sampling params (seed, n, best_of, min_p) (#3055) · 3de04dd9
  Greg Clark authored Sep 17, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  3de04dd9
- feat: add chat_template_kwargs param to v1/chat/completion (#3016) · eb6722e3
  Chi McIsaac authored Sep 17, 2025
```
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
```
  eb6722e3
16 Sep, 2025 3 commits
- chore(llm): Remove extra license headers (#3065) · bc0a7633
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bc0a7633
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
- chore: 400 Error Code for Bad Completion and ChatCompletion Request (#3038) · dcd331ab
  Ayush Agarwal authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  dcd331ab
15 Sep, 2025 1 commit

feat: Tool calling support stream=True (#2932) · 2a61e29e

Elyas Mehtabuddin authored Sep 15, 2025


Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>

2a61e29e

09 Sep, 2025 2 commits
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- fix: aggregate logprobs (#2928) · 8e4ae22b
  Greg Clark authored Sep 09, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  8e4ae22b
04 Sep, 2025 1 commit
- chore: frontend API changes for thinking budget (#2848) · 8d30753f
  Bhuvan Agrawal authored Sep 03, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
```
  8d30753f
29 Aug, 2025 2 commits
- chore: added include_stop_str_in_output (#2782) · 1f6b83be
  Ayush Agarwal authored Aug 29, 2025
  
  1f6b83be
- chore: deprecate nvext.top_k and nvext.repetition_penalty and make available top level (#2767) · 63f5bbc0
  ryan-lempka authored Aug 28, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  63f5bbc0
28 Aug, 2025 2 commits
- feat: Prevent double-tokenization when EPP picks worker (#2559) · 7d13b6e3
  atchernych authored Aug 28, 2025
  
  7d13b6e3
- chore: deprecate duplicate params in nvext (#2754) · e3619ce0
  ryan-lempka authored Aug 27, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  e3619ce0
26 Aug, 2025 2 commits
- feat: align OpenAI response IDs with distributed trace IDs (#2496) · a485ab78
  Chi McIsaac authored Aug 26, 2025
  
  a485ab78
- feat: parse normal text along with tool calls (#2709) · 889d6529
  Ayush Agarwal authored Aug 26, 2025
  
  889d6529
25 Aug, 2025 2 commits
- feat: enable --dyn-reasoning-parser flag to set reasoning parser for vllm deployments (#2700) · f5a41004
  nachiketb-nvidia authored Aug 25, 2025
  
  f5a41004
- feat: add gpt oss reasoning parser through harmony (#2656) · 3036e60b
  nachiketb-nvidia authored Aug 25, 2025
```
- couple of refactors
- added a new dependency, openai-harmony
- implemented the gpt oss parser
```
  3036e60b
22 Aug, 2025 2 commits
- chore: Rust to 1.89 and edition 2024 (#2659) · bce74588
  Graham King authored Aug 22, 2025
  
  bce74588
- feat: [vLLM] implement cli args for tool and reasoning parsers (#2619) · cbe854fc
  Ayush Agarwal authored Aug 22, 2025
  
  cbe854fc