Commits · 35fa7129db3e5c00cd8aad5000f30eb6841fca83 · OpenDAS / dynamo

24 Apr, 2026 1 commit

feat(v4): cherry-pick #8665 onto release/deepseekv4 (#8709) · 35fa7129

Keiven C authored Apr 24, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

35fa7129

23 Apr, 2026 1 commit
- fix(frontend): fix the rust frontend tool calling with guided decoding and... · 5671d8e3
  Richard Huo authored Apr 23, 2026
```
fix(frontend): fix the rust frontend tool calling with guided decoding and some model parsers fixes (#8442)
```
  5671d8e3
21 Apr, 2026 1 commit
- feat(lpu): add opaque engine_data field to nvext response with per-request opt-in via extra_fields · 1c9412d2
  Biswa Panda authored Apr 21, 2026
  
  1c9412d2
20 Apr, 2026 1 commit
- fix(parsers): recover Kimi K2 tool calls when section_end is missing (#8208) · 47cfbd46
  Keiven C authored Apr 20, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  47cfbd46
15 Apr, 2026 2 commits
- fix(discovery): spawn handle_put tasks concurrently to prevent replay wedging (#7931) · 470bb48f
  MatejKosec authored Apr 15, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  470bb48f
- fix(metrics): skip output token histogram for zero-output requests (#8085) · 60acaa7b
  Thomas Montfort authored Apr 15, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: Thomas Montfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  60acaa7b
14 Apr, 2026 1 commit
- feat: Decoder clean-up for handling incomplete multi-byte sequence (#8022) · 2cabf441
  Biswa Panda authored Apr 13, 2026
  
  2cabf441
11 Apr, 2026 2 commits
- fix(llm): support reading eos_token_ids from tokenizer_config.json for models... · b425b65c
  Ryan McCormick authored Apr 10, 2026
```
fix(llm): support reading eos_token_ids from tokenizer_config.json for models like Qwen3.5 with <|im_end|> token (#8091)
```
  b425b65c
- feat: Request Migration disable on max seq len exceeded (#8020) · f6976e7f
  Jacky authored Apr 10, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  f6976e7f
08 Apr, 2026 1 commit
- refactor(3/3): switch dynamo-protocols to upstream async-openai types (#7625) · fd5cc288
  ishandhanani authored Apr 08, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fd5cc288
07 Apr, 2026 1 commit
- fix(parsers): parallel XML/JSON tool calls no longer drop N-1 of N calls (#7914) · 91700375
  MatejKosec authored Apr 06, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  91700375
06 Apr, 2026 1 commit
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
03 Apr, 2026 1 commit
- feat: request lifecycle logging + metrics capture [DIS-1643] (#7840) · 679d9f14
  Neelay Shah authored Apr 02, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  679d9f14
02 Apr, 2026 2 commits
- feat: support chat_template.json as a prompt formatter artifact (#7785) · 06a24503
  Neal Vaidya authored Apr 02, 2026
```
Closes https://github.com/ai-dynamo/dynamo/issues/7737
```
  06a24503
- fix: tool_choice=required bypasses format-specific parsers (#6821) (#7589) · 07af8dca
  Asad Shahid authored Apr 02, 2026
  
  07af8dca
01 Apr, 2026 1 commit
- refactor(2/3): rename dynamo-async-openai to dynamo-protocols (#7565) · b6a3b0c6
  ishandhanani authored Apr 01, 2026
  
  b6a3b0c6
31 Mar, 2026 2 commits
- feat: add initial audio/TTS pipeline support for vLLM-omni backend (#7495) · cbbde3d0
  Zhongdongming Dai authored Mar 31, 2026
```
Signed-off-by: Zhongdongming Dai <zhongdongmin@nvidia.com>
```
  cbbde3d0
- fix: allow having no rust tokenizer when using dyn-chat-processor vllm (#7697) · 76c70f41
  Neal Vaidya authored Mar 31, 2026
  
  76c70f41
30 Mar, 2026 1 commit
- refactor(1/3): move `nvext` to `dynamo-llm` and move `anthropic` to `dynamo-async-openai` (#7564) · 2887cd1c
  ishandhanani authored Mar 30, 2026
  
  2887cd1c
25 Mar, 2026 1 commit
- fix(frontend): carry forward real stream metadata in JailedStream finalization (#7608) · 0adfd98d
  vvagias authored Mar 24, 2026
  
  0adfd98d
15 Mar, 2026 1 commit
- feat: integrate fastokens BPE tokenizer backend (#7387) · da810a26
  Biswa Panda authored Mar 15, 2026
  
  da810a26
11 Mar, 2026 1 commit
- feat(anthropic): add thinking block support and preamble stripping to /v1/messages (#7137) · 012236ee
  MatejKosec authored Mar 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  012236ee
06 Mar, 2026 2 commits
- fix: Kimi K2.5 - tiktoken incomplete multi-byte sequence handling with regression tests (#6996) · d71c0c32
  Biswa Panda authored Mar 06, 2026
  
  d71c0c32
- fix: reject prompts exceeding max_seq_len with HTTP 400 (#6635) · 124ecd98
  Yuewei Na authored Mar 05, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  124ecd98
05 Mar, 2026 1 commit
- fix(llm): preserve reasoning content when tool-call starts mid-chunk (#6902) · 57e6a79f
  Graham King authored Mar 05, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  57e6a79f
03 Mar, 2026 1 commit
- feat: upgrade rust to v1.93.0 (#6802) · 57bdbdf1
  Ryan Olson authored Mar 03, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  57bdbdf1
25 Feb, 2026 2 commits
- feat: Tiktoken support (#6460) · 21fce9ba
  Nikita authored Feb 25, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
```
  21fce9ba
- feat: Kimi K2/K2.5 tool and reasoning parsers (#6407) · d1bd210f
  Nikita authored Feb 25, 2026
```
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
```
  d1bd210f
24 Feb, 2026 3 commits

feat: add error_type label to reqs metric for fine-grained error classification (#5568) · 432fae67

Vladislav Nosivskoy authored Feb 24, 2026


Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

432fae67

feat: Standardized Dynamo Error Type (#6303) · c8276cd2
Jacky authored Feb 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
c8276cd2
fix(api): preserve interleaved reasoning order for KV cache correctness (#6442) · a9e06960
MatejKosec authored Feb 23, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
a9e06960

23 Feb, 2026 1 commit
- feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) · cb55766c
  Thomas Montfort authored Feb 23, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  cb55766c
18 Feb, 2026 1 commit

feat: add Anthropic Messages API endpoint (/v1/messages) (#6231) · b6603d90

ishandhanani authored Feb 18, 2026


Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Matej Kosec <mkosec@nvidia.com>

b6603d90

13 Feb, 2026 1 commit
- feat: add video generation support (T2V) (#5793) · 2be83be2
  ishandhanani authored Feb 13, 2026
  
  2be83be2
11 Feb, 2026 2 commits
- feat: Metric for detokenization latency (#6160) · adaf1a39
  Graham King authored Feb 11, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  adaf1a39
- feat: support `reasoning_content` context management (DeepSeek v3.2 & GLM-4.7 & Kimi-2.5) (#6107) · 2cee89a0
  Vladislav Nosivskoy authored Feb 11, 2026
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  2cee89a0
10 Feb, 2026 1 commit
- feat: Add metric tokenizer_latency_ms (#6092) · f1bcb175
  Graham King authored Feb 10, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f1bcb175
09 Feb, 2026 1 commit
- feat: text to image vLLM Omni (#5912) · 9f76d060
  Ayush Agarwal authored Feb 09, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  9f76d060
06 Feb, 2026 1 commit
- refactor: Move --migration-limit flag from backend to frontend (#5918) · 1ffa489e
  Jacky authored Feb 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  1ffa489e
05 Feb, 2026 1 commit

chore: remove unused NIM specific code (part 2) (#5893) · cb7ebdd7

Keiven C authored Feb 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

cb7ebdd7