Commits · 7fabe7bfe2a5601858cbe72c94f16f04da2ca0f7 · OpenDAS / dynamo · GitLab

01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 3 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- feat: DIS-373 dynamo KVBM connector API integration with TRTLLM (#2544) · a68c2f8f
  Richard Huo authored Aug 29, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  a68c2f8f
- feat: add logits processor support for trtllm backend (#2702) · 43a26958
  Bhuvan Agrawal authored Aug 29, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  43a26958
29 Aug, 2025 4 commits
- chore: add more reasoning and tool call parsers explicitly, remove unecessary files (#2785) · 295964e3
  nachiketb-nvidia authored Aug 29, 2025
```
Signed-off-by: nachiketb <nachiketb@nvidia.com>
```
  295964e3
- chore: added include_stop_str_in_output (#2782) · 1f6b83be
  Ayush Agarwal authored Aug 29, 2025
  
  1f6b83be
- feat: add Prometheus metrics integration for KvStats (#2704) · 15539fd0
  Keiven C authored Aug 28, 2025
```
Signed-off-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  15539fd0
- chore: deprecate nvext.top_k and nvext.repetition_penalty and make available top level (#2767) · 63f5bbc0
  ryan-lempka authored Aug 28, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  63f5bbc0
28 Aug, 2025 6 commits
- feat: Prevent double-tokenization when EPP picks worker (#2559) · 7d13b6e3
  atchernych authored Aug 28, 2025
  
  7d13b6e3
- feat: Integrate Model Express Client into Dynamo Model Downloads (#2574) · 95ce83d5
  KavinKrishnan authored Aug 28, 2025
```
Signed-off-by: Kavin Krishnan <kavink@nvidia.com>
Co-authored-by: KavinKrishnan <kavin.krishnan@nvidia.com>
```
  95ce83d5
- fix: Added description to async-openai/Cargo.toml (#2761) · fee976a2
  Dmitry Tokarev authored Aug 28, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fee976a2
- refactor: centralize Prometheus metrics naming and sanitization DIS-554 (#2733) · 84c9890b
  Keiven C authored Aug 28, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  84c9890b
- chore: deprecate duplicate params in nvext (#2754) · e3619ce0
  ryan-lempka authored Aug 27, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  e3619ce0
- feat: Add vLLM multimodal video support (#2738) · 78a11074
  Kris Hung authored Aug 27, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  78a11074
27 Aug, 2025 3 commits
- feat: KServe gRPC support (#2638) · 91a459c0
  GuanLuo authored Aug 26, 2025
  
  91a459c0
- feat: Trtllm metric_labels. (#2666) · ef535edb
  Tzu-Ling Kan authored Aug 26, 2025
  
  ef535edb
- feat: allow specifying consumer name for NATS queue + manually purge old messages (#2740) · b9640e5c
  Yan Ru Pei authored Aug 26, 2025
  
  b9640e5c
26 Aug, 2025 2 commits
- feat: align OpenAI response IDs with distributed trace IDs (#2496) · a485ab78
  Chi McIsaac authored Aug 26, 2025
  
  a485ab78
- feat: parse normal text along with tool calls (#2709) · 889d6529
  Ayush Agarwal authored Aug 26, 2025
  
  889d6529
25 Aug, 2025 7 commits
- feat: enable --dyn-reasoning-parser flag to set reasoning parser for vllm deployments (#2700) · f5a41004
  nachiketb-nvidia authored Aug 25, 2025
  
  f5a41004
- refactor: move uptime tracking from system_status_server(HTTP) to DRT level (#2587) · 68fb3d95
  Keiven C authored Aug 25, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  68fb3d95
- feat: python bindings for the entire KvPushRouter + per-request router configs (#2658) · f08729ae
  Yan Ru Pei authored Aug 25, 2025
  
  f08729ae
- refactor: Switch ModelManager locks from `std::sync::Mutex` to `parking_lot::Mutex` (#2696) · 8e4d81f3
  Paul Hendricks authored Aug 25, 2025
  
  8e4d81f3
- feat: support HF_HOME/_ENDPOINT env for Hugging Face models (#2642) · a24221d4
  Hyeonki Hong authored Aug 26, 2025
```
Signed-off-by: Hyeonki Hong <hhk7734@gmail.com>
```
  a24221d4
- feat: add gpt oss reasoning parser through harmony (#2656) · 3036e60b
  nachiketb-nvidia authored Aug 25, 2025
```
- couple of refactors
- added a new dependency, openai-harmony
- implemented the gpt oss parser
```
  3036e60b
- feat: add initial batch of KVBM metrics on match, offload and onboard (#2673) · b39382ba
  Ziqi Fan authored Aug 25, 2025
  
  b39382ba
24 Aug, 2025 1 commit
- fix: pytest robustness and parsing error (#2676) · 9b9f2ce4
  Alec authored Aug 24, 2025
  
  9b9f2ce4
23 Aug, 2025 1 commit
- fix: Skip checksum tests in release mode since they're not computed (#2669) · 05913af5
  Ryan McCormick authored Aug 22, 2025
  
  05913af5
22 Aug, 2025 8 commits
- fix: move metrics registration to service creation (#2664) · 92151e3e
  Keiven C authored Aug 22, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  92151e3e
- chore: Rust to 1.89 and edition 2024 (#2659) · bce74588
  Graham King authored Aug 22, 2025
  
  bce74588
- fix: handle missing span_name in logging test assertions (#2665) · f19b44a9
  Waël Boukhobza authored Aug 22, 2025
  
  f19b44a9
- feat: [vLLM] implement cli args for tool and reasoning parsers (#2619) · cbe854fc
  Ayush Agarwal authored Aug 22, 2025
  
  cbe854fc
- feat: enable dynamo metrics on KVBM (#2626) · b658ba61
  Ziqi Fan authored Aug 22, 2025
  
  b658ba61
- fix: Tests now pass with RUST_BACKTRACE set (#2647) · 819bb62f
  Graham King authored Aug 22, 2025
  
  819bb62f
- feat: add BaseLogitsProcessor core interface (#2613) · b92a805e
  Bhuvan Agrawal authored Aug 22, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
```
  b92a805e
- chore(llm): Rename protocols::Endpoint to EndpointId (#2615) · 6a358f7c
  Graham King authored Aug 22, 2025
  
  6a358f7c
21 Aug, 2025 4 commits
- fix: guard inflight_requests and request_duration from early returns. (#2576) · 105436c3
  Tzu-Ling Kan authored Aug 21, 2025
  
  105436c3
- fix: Httpengine sync-enable-endpoint (#2591) · 174389e6
  Michael Feil authored Aug 21, 2025
  
  174389e6
- feat: enable basic reasoning parsing of <think> </think> tokens (#2555) · 8e8152a1
  nachiketb-nvidia authored Aug 21, 2025
  
  8e8152a1
- feat: Add model label for vllm backend metrics (#2474) · 57728909
  Tzu-Ling Kan authored Aug 21, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  57728909