Commits · 04442173397a4fcb35d3e16c087ac0f7dfeefb29 · OpenDAS / dynamo · GitLab

18 Aug, 2025 3 commits
- fix: replace metrics callback with background scraping to prevent tim… (#2480) · 04442173
  Keiven C authored Aug 18, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  04442173
- fix: use random port assignment for http tests (#2472) · e63d728f
  ryan-lempka authored Aug 18, 2025
  
  e63d728f
- chore: enable tool call array parsing (#2466) · 41f095cf
  Ayush Agarwal authored Aug 18, 2025
  
  41f095cf
15 Aug, 2025 5 commits
- chore: Tool call parsers incremental improvements + Model Specific Parsers (#2457) · a7184bec
  Ayush Agarwal authored Aug 15, 2025
  
  a7184bec
- fix: remove kvmanager feature from python 3.12 ai-dynamo-runtime wheel (#2456) · ffae72b7
  Harrison Saturley-Hall authored Aug 15, 2025
  
  ffae72b7
- feat: add basic implementation of reasoning parsers (#2410) · b5cf1ad3
  nachiketb-nvidia authored Aug 15, 2025
  
  b5cf1ad3
- feat: Dynamic Endpoint Exposure Based on Model Type (#1447) · 537759f1
  Abrar Shivani authored Aug 15, 2025
  
  537759f1
- feat(metrics): add NATS client metrics to prometheus_metrics_fmt (#2292) · acbdabc4
  Keiven C authored Aug 14, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  acbdabc4
14 Aug, 2025 5 commits
- perf: Only compute checksums on debug builds (#2446) · 9ddb3efd
  jthomson04 authored Aug 14, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  9ddb3efd
- feat: Add a "model" label to Component metrics (#2389) · 3a3f5bf2
  Tzu-Ling Kan authored Aug 14, 2025
  
  3a3f5bf2
- feat: add RuntimeConfig to ModelEntry (#2311) · d0a63635
  Jorge António authored Aug 14, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  d0a63635
- chore: deprecate sentencepiece tokenizer in lib/llm (#2439) · e71f71f4
  Lanqing Yang authored Aug 14, 2025
```
Signed-off-by: lyang24 <lanqingy93@gmail.com>
```
  e71f71f4
- feat: logprob handling (#2426) · f476fd74
  Greg Clark authored Aug 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  f476fd74
13 Aug, 2025 7 commits
- fix: Fix ETCD and NATS starvation under massive request concurrency (#2384) · dcfa87be
  jthomson04 authored Aug 13, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  dcfa87be
- feat: enable custom metrics prefix (#2432) · 3411bda8
  ryan-lempka authored Aug 13, 2025
  
  3411bda8
- chore: Refactor tool calling for wider support in the future (#2393) · 086ea4f0
  Elyas Mehtabuddin authored Aug 13, 2025
  
  086ea4f0
- fix: upgrade cudarc to 0.17.1 (#2341) · c12c2578
  Dan Aloni authored Aug 13, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  c12c2578
- fix: Add detokenize stream (#2413) · 8c40bbb0
  jthomson04 authored Aug 13, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  8c40bbb0
- feat: LLM metrics for non-streaming requests in frontend (#2427) · c3ecaf6c
  Hongkuan Zhou authored Aug 13, 2025
  
  c3ecaf6c
- feat: Allow an endpoint to serve multiple models (#2418) · 72ec5f5c
  Graham King authored Aug 13, 2025
  
  72ec5f5c
12 Aug, 2025 2 commits

feat: multi-modal example with vLLM v1 and UX v2 (#2040) · 9b87c89c
GuanLuo authored Aug 12, 2025
```
Co-authored-by: krishung5 <krish@nvidia.com>
```
9b87c89c

feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of... · 18bb779e

KrishnanPrash authored Aug 12, 2025

feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of `nvext`) and Structured Output / Guided Decoding (#2380)
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>

18bb779e

11 Aug, 2025 3 commits
- refactor: rename to system status server for consistency (#2354) · c91e2e49
  Keiven C authored Aug 11, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c91e2e49
- fix(preprocessor): Populate model ID in PreprocessedRequest (#2397) · c443528f
  Graham King authored Aug 11, 2025
  
  c443528f
- feat: cuda traits and interoperability with external contexts (#2340) · b5efb957
  Ryan Olson authored Aug 11, 2025
  
  b5efb957
07 Aug, 2025 8 commits
- feat: Router replicas with state-sharing (#2264) · 5166a3dd
  Yan Ru Pei authored Aug 07, 2025
  
  5166a3dd
- build: introduce dynamo base container (#2222) · 10f4302d
  Tushar Sharma authored Aug 07, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  10f4302d
- chore: guided decoding support for nvext (#2339) · b165ec4a
  Ayush Agarwal authored Aug 07, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  b165ec4a
- chore(metrics): Remove the Arc (#2357) · a3f7a39f
  Graham King authored Aug 07, 2025
  
  a3f7a39f
- feat: cross process instrumentation (#2243) · bd4fe1a7
  Neelay Shah authored Aug 07, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
```
  bd4fe1a7
- chore: Remove service_name from ModelDeploymentCard (#2349) · 1954fcfa
  Graham King authored Aug 07, 2025
  
  1954fcfa
- fix: improve HF token handling in preprocessor tests (#2321) · ccc8815b
  Keiven C authored Aug 06, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  ccc8815b
- refactor: Rename HTTP server to metrics server in worker process (#2318) · 254f4819
  Yingge He authored Aug 06, 2025
  
  254f4819
06 Aug, 2025 5 commits
- fix: Restore running single-process without etcd (#2342) · 63fbf498
  Graham King authored Aug 06, 2025
  
  63fbf498
- chore: Bump mistral.rs, llama.cpp and tokenizers deps (#2338) · dbe48a1d
  Graham King authored Aug 06, 2025
  
  dbe48a1d
- fix: upgrade axum to 0.8 and etcd-client to 0.16 (#2317) · b2aa504b
  Dan Aloni authored Aug 06, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
```
  b2aa504b
- feat: Support static workers, run without etcd. (#2281) · 6a1a801c
  Graham King authored Aug 06, 2025
  
  6a1a801c
- feat: recorder graceful drop (#2327) · 0802ecd9
  Yan Ru Pei authored Aug 05, 2025
  
  0802ecd9
05 Aug, 2025 2 commits
- ci: Improve caching on pre-merge-rust (#2253) · e95f8758
  Ryan McCormick authored Aug 05, 2025
  
  e95f8758
- feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e
  Hongkuan Zhou authored Aug 05, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  36c4ef5e