Commits · f8bb53c0ed274b877af7f99bc21508f113ae2956 · OpenDAS / dynamo

11 Dec, 2025 1 commit

feat: add cached tokens prometheus metric (#4534) · f8bb53c0

Vladislav Nosivskoy authored Dec 11, 2025


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

f8bb53c0

09 Dec, 2025 1 commit
- feat: add tool_choice support (#4722) · 5585f803
  Vladislav Nosivskoy authored Dec 09, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  5585f803
10 Oct, 2025 1 commit
- chore: remove deprecated nvext parameters for 6.0 (#3551) · b954a249
  ryan-lempka authored Oct 10, 2025
  
  b954a249
26 Sep, 2025 1 commit
- chore: added more api error code validations (#3231) · d4f0d2bc
  Ayush Agarwal authored Sep 26, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d4f0d2bc
17 Sep, 2025 1 commit
- chore: fillout sampling params (seed, n, best_of, min_p) (#3055) · 3de04dd9
  Greg Clark authored Sep 17, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  3de04dd9
16 Sep, 2025 1 commit
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
04 Sep, 2025 1 commit
- chore: frontend API changes for thinking budget (#2848) · 8d30753f
  Bhuvan Agrawal authored Sep 03, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
```
  8d30753f
29 Aug, 2025 2 commits
- chore: added include_stop_str_in_output (#2782) · 1f6b83be
  Ayush Agarwal authored Aug 29, 2025
  
  1f6b83be
- chore: deprecate nvext.top_k and nvext.repetition_penalty and make available top level (#2767) · 63f5bbc0
  ryan-lempka authored Aug 28, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  63f5bbc0
28 Aug, 2025 1 commit
- chore: deprecate duplicate params in nvext (#2754) · e3619ce0
  ryan-lempka authored Aug 27, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  e3619ce0
22 Aug, 2025 2 commits
- chore: Rust to 1.89 and edition 2024 (#2659) · bce74588
  Graham King authored Aug 22, 2025
  
  bce74588
- feat: [vLLM] implement cli args for tool and reasoning parsers (#2619) · cbe854fc
  Ayush Agarwal authored Aug 22, 2025
  
  cbe854fc
21 Aug, 2025 1 commit
- chore: Remove Clone / Sync from DeltaGenerator (#2598) · 0c50a233
  Graham King authored Aug 21, 2025
  
  0c50a233
14 Aug, 2025 1 commit
- feat: logprob handling (#2426) · f476fd74
  Greg Clark authored Aug 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  f476fd74
12 Aug, 2025 1 commit

feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of... · 18bb779e

KrishnanPrash authored Aug 12, 2025

feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of `nvext`) and Structured Output / Guided Decoding (#2380)
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>

18bb779e

07 Aug, 2025 1 commit
- chore: guided decoding support for nvext (#2339) · b165ec4a
  Ayush Agarwal authored Aug 07, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  b165ec4a
01 Jul, 2025 2 commits
- feat: Validation engine for validating OpenAI api request data (#1674) · ee86bad3
  Nathan Barry authored Jul 01, 2025
  
  ee86bad3
- feat: Support for Responses API (#1694) · dfbd741d
  Paul Hendricks authored Jul 01, 2025
  
  dfbd741d
26 Jun, 2025 1 commit
- refactor: remove dead protocols code and organize imports idiomatically (#1669) · 9d7c5df5
  Paul Hendricks authored Jun 26, 2025
  
  9d7c5df5
24 Jun, 2025 1 commit
- refactor: refactoring to use async_openai::types::CompletionUsage (#1397) · 0c9ae4dd
  Paul Hendricks authored Jun 24, 2025
  
  0c9ae4dd
03 Jun, 2025 1 commit

feat: add more metrics to rust frontend (#1315) · 98d4abbb

Hongkuan Zhou authored Jun 03, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: jothomson <jwillthomson19@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

98d4abbb

19 May, 2025 1 commit

feat: Add OpenAI Embeddings interface in rust lib (#1110) · 73fdfb8a

Tom O'Brien authored May 19, 2025

Implements OpenAI embeddings (interface only).

- Adds ModelType::Embedding
- Adds OpenAI embedding request/response structs
- Adds support for embedding model discovery

73fdfb8a

05 Mar, 2025 1 commit
- refactor: rename triton_distributed to dynemo (#22) · 1af7433b
  Neelay Shah authored Mar 05, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  1af7433b
28 Feb, 2025 1 commit
- refactor: use async-openai CompletionRequest (#310) · 9162f3ad
  Paul Hendricks authored Feb 28, 2025
  
  9162f3ad
26 Feb, 2025 1 commit
- refactor: using async_openai · 86aff237
  Paul Hendricks authored Feb 26, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  86aff237
25 Feb, 2025 1 commit

refactor: move libs to lib dir · 08fcd7e9

Neelay Shah authored Feb 24, 2025


Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

08fcd7e9

10 Feb, 2025 1 commit

feat: OpenAI compatible http service (#123) · ffc6dde1

Ryan Olson authored Feb 10, 2025


Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

ffc6dde1