Commits · b1286e7f6c2477d4423444ca9e34e6143086dacd · OpenDAS / dynamo

"lib/llm/src/entrypoint/input/batch.rs" did not exist on "9f0e12a04b8d392e8d1ab2491469170eb140c302"

22 Nov, 2025 1 commit
- fix: health check endpoint (#4522) · b1286e7f
  Biswa Panda authored Nov 21, 2025
  
  b1286e7f
21 Nov, 2025 16 commits
- chore: Make nats_client private at crate level, various tidy up (#4513) · f05f7629
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f05f7629
- fix(storage): Correctly encoding FileStore keys (#4539) · 27904535
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  27904535
- chore: split frontend + runtime launch message to accurately represent container purpose (#4537) · f2769d88
  Tushar Sharma authored Nov 21, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  f2769d88
- fix: fix PVC in shared frontend example (#4517) · b7667c48
  Julien Mancuso authored Nov 21, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  b7667c48
- fix: better instructions for GAIE recipe (#4525) · b6f31b41
  atchernych authored Nov 21, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  b6f31b41
- docs: Add Recipes to ToC and bump FW Support Matrix further up (#4536) · cb2ea1be
  Harry Kim authored Nov 21, 2025
```
Signed-off-by: Harry Kim <harry_kim@live.com>
```
  cb2ea1be
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- fix: worker_id updates not applied (#4518) · 989e246e
  Zhongxuan (Daniel) Wang authored Nov 21, 2025
```
Signed-off-by: Zhongxuan (Daniel) Wang <daniewang@nvidia.com>
```
  989e246e
- chore: parallelize planner profile tests + bindings test cleanup (#4532) · d821a8b9
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d821a8b9
- feat: Xml coder tool parser (#4415) · 65f18884
  William Zhang authored Nov 21, 2025
```
This commit adds a parser implementation for Xml style
tool calls, based currently on Qwen3 coder.

Followup work needs to be done to make it more generic
and parameterizable.
```
  65f18884
- fix: set `SGLANG_BLOCK_NONZERO_RANK_CHILDREN` to be no-op (#4527) · 6b432625
  ishandhanani authored Nov 20, 2025
  
  6b432625
- feat: add an optional PVC mounting option to DGDR for profiling (#4503) · 36f58e36
  hhzhang16 authored Nov 20, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  36f58e36
- fix: missing tool calling usage (#4516) · 179ee38b
  Ayush Agarwal authored Nov 20, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  179ee38b
- ci: Testing b64 multimodal support with real image (#4280) · e7544f19
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  e7544f19
- test: parallel mocker tests in CI (#4493) · 6e241236
  Yan Ru Pei authored Nov 20, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6e241236
- chore: update model cache pvc name to match recipes (#4506) · febdc998
  Hongkuan Zhou authored Nov 20, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  febdc998
20 Nov, 2025 19 commits
- fix: Support for msg[content] as a list (#4485) · 6767559f
  KrishnanPrash authored Nov 20, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  6767559f
- chore: Use general engine source for KVBM KV events (#4515) · 2f18b23e
  Kris Hung authored Nov 20, 2025
  
  2f18b23e
- fix: [k8s service discovery] only replace service account when one isn't set (#4505) · edab1ac4
  hhzhang16 authored Nov 20, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  edab1ac4
- ci: OPS-2134: Add framework builds to nightlies (#4435) · 21a03b31
  Dillon Cullinan authored Nov 20, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Co-authored-by: Nate Mailhot <nmailhot@nvidia.com>
```
  21a03b31
- feat: Add metrics endpoint to kserve gRPC service (#4400) · 5fe0476e
  Tanmay Verma authored Nov 20, 2025
  
  5fe0476e
- docs: Fix typo in hidden_toctree.rst (#4511) · 826eea05
  Ryan McCormick authored Nov 20, 2025
  
  826eea05
- ci: Add manual trigger variable (#4490) · feb325f5
  Pavithra Vijayakrishnan authored Nov 20, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  feb325f5
- fix(operator): reconcile user made edits on resources (#4470) · 796520bb
  Thomas Montfort authored Nov 20, 2025
  
  796520bb
- chore: Remove DistributedRuntime::etcd_client (#4489) · 8a14f9ed
  Graham King authored Nov 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8a14f9ed
- docs: update Latest News section in README (#4452) · d1ce4236
  Anish authored Nov 20, 2025
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
```
  d1ce4236
- chore: update low latency fp8 (#4499) · 02199790
  ishandhanani authored Nov 19, 2025
  
  02199790
- chore: better error handling in Router slot manager (#4496) · c0c664a9
  Yan Ru Pei authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c0c664a9
- fix: same endpoint for tcp health check (#4494) · 55c66a63
  Biswa Panda authored Nov 19, 2025
  
  55c66a63
- fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  75bf7c9b
- docs: add documentation for request plane (#4491) · 5dafe10b
  Biswa Panda authored Nov 19, 2025
  
  5dafe10b
- test: Router CI tests with vLLM engine (#3948) · d461631b
  Karen Chung authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  d461631b
- feat: add validation webhooks (#4416) · 872900f1
  Julien Mancuso authored Nov 19, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  872900f1
- feat: Report KVBM cache hit rate (#4333) · b2605a8e
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  b2605a8e
- docs: add Developing Locally section to KVBM runbooks (#4488) · b0605788
  Ziqi Fan authored Nov 19, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  b0605788
19 Nov, 2025 4 commits
- fix: use hf id in dsr1 recipe to support DGDR (#4481) · f3f764eb
  Hongkuan Zhou authored Nov 19, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f3f764eb
- chore: Remove unused leader_worker_barrier (#4480) · 473cb57e
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  473cb57e
- fix: support multimodal models with non-standard Jinja2 tags (#4379) · f395b641
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f395b641
- fix: add env var for model (#4475) · 4215b59a
  atchernych authored Nov 19, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  4215b59a