Commits · 27904535fb127b8be8c3f5d192879a196df7b729 · OpenDAS / dynamo · GitLab

19 Nov, 2025 1 commit
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
18 Nov, 2025 2 commits
- fix: Set annotated_usage.event to None in the final usage chunk response (#3729) · 33d9ae78
  Shuaiyi Zhang authored Nov 19, 2025
```
Signed-off-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Shuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  33d9ae78
- fix: Move trtllm multimodal worker to use ModelInput.Token (#4373) · c3984bc2
  Indrajit Bhosale authored Nov 17, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  c3984bc2
08 Nov, 2025 1 commit
- fix: no more multiple finish reasons in stream (#4154) · 04f7579b
  Ayush Agarwal authored Nov 07, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  04f7579b
04 Nov, 2025 1 commit
- feat: Image decoder in the frontend (#3971) · ae4b08ac
  milesial authored Nov 04, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  ae4b08ac
31 Oct, 2025 1 commit
- feat: Media HTTP fetching and b64 decoding (#3967) · e30a3054
  milesial authored Oct 31, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  e30a3054
29 Oct, 2025 1 commit
- chore: add usage field to non-streaming responses by default (#3922) · 3fe5653b
  Ayush Agarwal authored Oct 29, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  3fe5653b
27 Oct, 2025 1 commit
- feat: Media URL passthrough in OAI preprocessor (#3733) · a79122c6
  milesial authored Oct 27, 2025
```
Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
```
  a79122c6
14 Oct, 2025 1 commit
- fix: Add support for single element arrays for chat and completions prompts (#3482) · 3dc25129
  zhongdaor-nv authored Oct 14, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  3dc25129
07 Oct, 2025 1 commit
- chore(discovery): Watch/publish ModelDeploymentCard instead of ModelEntry (#3350) · 81162dfe
  Graham King authored Oct 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  81162dfe
01 Oct, 2025 2 commits
- fix: Polling from exhausted stream in preprocessor (#3349) · a5e1d45e
  Jacky authored Oct 01, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  a5e1d45e
- feat: reasoning parser transformation (#3295) · 2a2bf58a
  Ayush Agarwal authored Oct 01, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  2a2bf58a
30 Sep, 2025 1 commit
- feat: add audit logging for chat completions (#3062) · 56d20f53
  ryan-lempka authored Sep 30, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  56d20f53
23 Sep, 2025 1 commit
- feat: JailedStream (#3034) · c63cceaa
  Ryan Olson authored Sep 23, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c63cceaa
18 Sep, 2025 2 commits
- feat: enhance GPT OSS frontend with improved harmony tool calling parser and... · 6675bfc8
  zhongdaor-nv authored Sep 18, 2025
```
feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  6675bfc8
- chore: set default tool calling behaviour to be disabled (#3096) · 37322011
  Ayush Agarwal authored Sep 17, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  37322011
17 Sep, 2025 1 commit

fix: harmony parser streaming fix (#3074) · cd814377

Ayush Agarwal authored Sep 17, 2025


Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Graham King <grahamk@nvidia.com>

cd814377

16 Sep, 2025 1 commit
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
15 Sep, 2025 1 commit

feat: Tool calling support stream=True (#2932) · 2a61e29e

Elyas Mehtabuddin authored Sep 15, 2025


Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>

2a61e29e

05 Sep, 2025 1 commit
- fix: Load the tokenizer JSON once for chat and completions. (#2910) · cb5a657a
  Graham King authored Sep 05, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cb5a657a
03 Sep, 2025 1 commit

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

02 Sep, 2025 1 commit
- fix: Do not apply chat template to completions (#2718) · 2422b83d
  Graham King authored Sep 02, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2422b83d
28 Aug, 2025 1 commit
- feat: Prevent double-tokenization when EPP picks worker (#2559) · 7d13b6e3
  atchernych authored Aug 28, 2025
  
  7d13b6e3
26 Aug, 2025 1 commit
- feat: align OpenAI response IDs with distributed trace IDs (#2496) · a485ab78
  Chi McIsaac authored Aug 26, 2025
  
  a485ab78
25 Aug, 2025 1 commit
- feat: enable --dyn-reasoning-parser flag to set reasoning parser for vllm deployments (#2700) · f5a41004
  nachiketb-nvidia authored Aug 25, 2025
  
  f5a41004
22 Aug, 2025 2 commits
- chore: Rust to 1.89 and edition 2024 (#2659) · bce74588
  Graham King authored Aug 22, 2025
  
  bce74588
- feat: [vLLM] implement cli args for tool and reasoning parsers (#2619) · cbe854fc
  Ayush Agarwal authored Aug 22, 2025
  
  cbe854fc
19 Aug, 2025 2 commits
- chore: Bring async-openai into repo as request starter (#2520) · 199b9a30
  nachiketb-nvidia authored Aug 19, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  199b9a30
- feat: skip router when worker id is pre-determined (#2450) · 6bc6d400
  atchernych authored Aug 19, 2025
```
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  6bc6d400
14 Aug, 2025 1 commit
- feat: logprob handling (#2426) · f476fd74
  Greg Clark authored Aug 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  f476fd74
11 Aug, 2025 1 commit
- fix(preprocessor): Populate model ID in PreprocessedRequest (#2397) · c443528f
  Graham King authored Aug 11, 2025
  
  c443528f
07 Aug, 2025 1 commit
- chore: Remove service_name from ModelDeploymentCard (#2349) · 1954fcfa
  Graham King authored Aug 07, 2025
  
  1954fcfa
23 Jul, 2025 1 commit
- feat: query instance_id based on routing strategy (#1787) · f3d784f3
  Biswa Panda authored Jul 23, 2025
  
  f3d784f3
10 Jul, 2025 1 commit
- perf(tokenizer): Make de-tokenize ~50% faster (#1868) · 61a1f4ff
  Graham King authored Jul 10, 2025
  
  61a1f4ff
03 Jul, 2025 1 commit
- feat: Implement frontend tokenization for embedding requests (#1494) · 47e7fde7
  Tom O'Brien authored Jul 03, 2025
  
  47e7fde7
27 Jun, 2025 1 commit
- feat: Parallelize tokenization during batch completion (#1657) · 7b076cfb
  Muthuraj Ramalingakumar authored Jun 27, 2025
  
  7b076cfb
26 Jun, 2025 1 commit
- refactor: refactored using CompletionResponse (#1658) · e3f1bd5d
  Paul Hendricks authored Jun 26, 2025
  
  e3f1bd5d
25 Jun, 2025 1 commit
- feat: support batch `/completions` (#1626) · fc16a79b
  ishandhanani authored Jun 25, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  fc16a79b
24 Jun, 2025 1 commit
- refactor: refactoring to use async_openai::types::CompletionUsage (#1397) · 0c9ae4dd
  Paul Hendricks authored Jun 24, 2025
  
  0c9ae4dd
11 Jun, 2025 1 commit
- refactor: use comment filed in annotated to pass metric-related information (#1385) · 227a0e71
  Hongkuan Zhou authored Jun 11, 2025
  
  227a0e71