Commits · 78a3fedab9010d02032430c90fab9270c745ae09 · OpenDAS / dynamo · GitLab

17 Sep, 2025 5 commits
- fix: hook up worker removals for indexer (#3095) · 78a3feda
  Yan Ru Pei authored Sep 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  78a3feda
- chore: fillout sampling params (seed, n, best_of, min_p) (#3055) · 3de04dd9
  Greg Clark authored Sep 17, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  3de04dd9
- feat: add chat_template_kwargs param to v1/chat/completion (#3016) · eb6722e3
  Chi McIsaac authored Sep 17, 2025
```
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
```
  eb6722e3
- feat: Make part of discovery re-usable (#3073) · 9060ce12
  Graham King authored Sep 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  9060ce12
- fix: purge before snapshotting (#3077) · d49fc3eb
  Yan Ru Pei authored Sep 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d49fc3eb
16 Sep, 2025 6 commits
- feat: kv commit router (#3024) · 0373b897
  Michael Feil authored Sep 16, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  0373b897
- chore(llm): Remove extra license headers (#3065) · bc0a7633
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  bc0a7633
- fix: Interactive inputs actually stops, does not ignore stop token (#3057) · 87e6e052
  Graham King authored Sep 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  87e6e052
- feat: add HTTP queue metrics for NIM frontend request tracking (#2914) · 9fa5450c
  Keiven C authored Sep 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9fa5450c
- fix: implement OpenAI-compliant usage stats for streaming responses (#3022) · aa80ac41
  Ryan Olson authored Sep 16, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  aa80ac41
- chore: 400 Error Code for Bad Completion and ChatCompletion Request (#3038) · dcd331ab
  Ayush Agarwal authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  dcd331ab
15 Sep, 2025 3 commits
- fix: Handle invalid JSON in config.json (#3043) · b1186aee
  Graham King authored Sep 15, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b1186aee
- feat: Tool calling support stream=True (#2932) · 2a61e29e
  Elyas Mehtabuddin authored Sep 15, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  2a61e29e
- fix: early stop if CPU or disk space not set when using KVBM (#2997) · 55659eae
  Ziqi Fan authored Sep 15, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  55659eae
10 Sep, 2025 3 commits
- feat: adds kv indexer metrics (#2905) · 40000976
  blarson-b10 authored Sep 10, 2025
```
Signed-off-by: Brian Larson <brian.larson@baseten.co>
```
  40000976
- docs: health check and structured logs (#2805) · 5d729c17
  Neelay Shah authored Sep 10, 2025
```
Signed-off-by: nnshah1 <neelays@nvidia.com>
```
  5d729c17
- feat: frontend, disconnect metrics (#1) (#2953) · e42746a1
  Michael Feil authored Sep 10, 2025
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  e42746a1
09 Sep, 2025 4 commits
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- fix: aggregate logprobs (#2928) · 8e4ae22b
  Greg Clark authored Sep 09, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  8e4ae22b
- chore: added tool call schema validation in oai formatter (#2935) · c319aa2d
  Ayush Agarwal authored Sep 09, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  c319aa2d
- feat: Add a checksum to ModelDeploymentCard fields (#2934) · 6f14e941
  Graham King authored Sep 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  6f14e941
05 Sep, 2025 4 commits
- fix: Load the tokenizer JSON once for chat and completions. (#2910) · cb5a657a
  Graham King authored Sep 05, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cb5a657a
- refactor: Refactor discovery ModelManager to use `parking_lot::RwLock` (#2902) · 8065fe12
  Paul Hendricks authored Sep 05, 2025
```
Signed-off-by: Paul Hendricks <phendricks@nvidia.com>
```
  8065fe12
- feat: kvbm transfer context v2 (dis-598) (#2873) · 85b3dd44
  Ryan Olson authored Sep 04, 2025
```
Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>
```
  85b3dd44
- feat: Router benchmarking (#2828) · 94f100bc
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  94f100bc
04 Sep, 2025 3 commits
- fix: router slot manager needs force expire requests (#2840) · 307d4039
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  307d4039
- chore: pass in mocker engine args directly in python cli + default frontend port to 8000 (#2853) · 3c7c1d64
  Yan Ru Pei authored Sep 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3c7c1d64
- chore: frontend API changes for thinking budget (#2848) · 8d30753f
  Bhuvan Agrawal authored Sep 03, 2025
```
Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>
```
  8d30753f
03 Sep, 2025 5 commits

refactor: Split ModelType to ModelInput for request and response type;... · 27fad26f

Olga Andreeva authored Sep 03, 2025

refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

27fad26f

feat: Add --custom-jinja-template argument to pass a custom chat template for vLLM (#2829) · c920cbd9
KrishnanPrash authored Sep 03, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
c920cbd9
feat: dynamo namespace isolation (#2394) · c6becbc8
Biswa Panda authored Sep 03, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
c6becbc8
feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
383e3b3a
chore: many bug fixes and improvements when testing planner (#2776) · 7da510cf
Hongkuan Zhou authored Sep 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: hongkuan <hongkuanz@nvidia.com>
```
7da510cf

02 Sep, 2025 2 commits
- fix: Do not apply chat template to completions (#2718) · 2422b83d
  Graham King authored Sep 02, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2422b83d
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 2 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- feat: DIS-373 dynamo KVBM connector API integration with TRTLLM (#2544) · a68c2f8f
  Richard Huo authored Aug 29, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  a68c2f8f
29 Aug, 2025 2 commits
- chore: added include_stop_str_in_output (#2782) · 1f6b83be
  Ayush Agarwal authored Aug 29, 2025
  
  1f6b83be
- feat: add Prometheus metrics integration for KvStats (#2704) · 15539fd0
  Keiven C authored Aug 28, 2025
```
Signed-off-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  15539fd0