Commits · 5fe0476e605d2564234f00e8123461e1594a9ce7 · OpenDAS / dynamo

"components/backends/vscode:/vscode.git/clone" did not exist on "43a26958d919083f2257f407c129fecc127c02e9"

20 Nov, 2025 15 commits
- feat: Add metrics endpoint to kserve gRPC service (#4400) · 5fe0476e
  Tanmay Verma authored Nov 20, 2025
  
  5fe0476e
- docs: Fix typo in hidden_toctree.rst (#4511) · 826eea05
  Ryan McCormick authored Nov 20, 2025
  
  826eea05
- ci: Add manual trigger variable (#4490) · feb325f5
  Pavithra Vijayakrishnan authored Nov 20, 2025
```
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
```
  feb325f5
- fix(operator): reconcile user made edits on resources (#4470) · 796520bb
  Thomas Montfort authored Nov 20, 2025
  
  796520bb
- chore: Remove DistributedRuntime::etcd_client (#4489) · 8a14f9ed
  Graham King authored Nov 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8a14f9ed
- docs: update Latest News section in README (#4452) · d1ce4236
  Anish authored Nov 20, 2025
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
```
  d1ce4236
- chore: update low latency fp8 (#4499) · 02199790
  ishandhanani authored Nov 19, 2025
  
  02199790
- chore: better error handling in Router slot manager (#4496) · c0c664a9
  Yan Ru Pei authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c0c664a9
- fix: same endpoint for tcp health check (#4494) · 55c66a63
  Biswa Panda authored Nov 19, 2025
  
  55c66a63
- fix: expose LMCache metrics via Dynamo metrics endpoint (#4461) · 75bf7c9b
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  75bf7c9b
- docs: add documentation for request plane (#4491) · 5dafe10b
  Biswa Panda authored Nov 19, 2025
  
  5dafe10b
- test: Router CI tests with vLLM engine (#3948) · d461631b
  Karen Chung authored Nov 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  d461631b
- feat: add validation webhooks (#4416) · 872900f1
  Julien Mancuso authored Nov 19, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  872900f1
- feat: Report KVBM cache hit rate (#4333) · b2605a8e
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  b2605a8e
- docs: add Developing Locally section to KVBM runbooks (#4488) · b0605788
  Ziqi Fan authored Nov 19, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  b0605788
19 Nov, 2025 22 commits
- fix: use hf id in dsr1 recipe to support DGDR (#4481) · f3f764eb
  Hongkuan Zhou authored Nov 19, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  f3f764eb
- chore: Remove unused leader_worker_barrier (#4480) · 473cb57e
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  473cb57e
- fix: support multimodal models with non-standard Jinja2 tags (#4379) · f395b641
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f395b641
- fix: add env var for model (#4475) · 4215b59a
  atchernych authored Nov 19, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  4215b59a
- fix: fix recipe docs (#4472) · f0e1f226
  atchernych authored Nov 19, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  f0e1f226
- feat(mistralrs): Upgrade to support CUDA 13 (#4474) · 2100f6aa
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2100f6aa
- fix: fix trtllm multinode deployment with LWS (#4477) · 17e22476
  Julien Mancuso authored Nov 19, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  17e22476
- feat: unregister discovery instance (#4459) · 781331c6
  Biswa Panda authored Nov 19, 2025
  
  781331c6
- fix: fix dgd.yaml (#4471) · 3ac39b78
  mohammedabdulwahhab authored Nov 19, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  3ac39b78
- feat: Enable autodeploy as a backend for TRT-LLM (#4347) · fe21d3dd
  William Zhang authored Nov 19, 2025
```
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
```
  fe21d3dd
- fix: no build in post-create.sh and document Docker 29.0.x issue (#4376) · c55509ae
  Keiven C authored Nov 19, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c55509ae
- fix: Revert "feat: kvbm kernels (#4356)" (#4467) · c2cc9782
  Dmitry Tokarev authored Nov 19, 2025
  
  c2cc9782
- fix: Update doc to assign port to avoid zmq port collision (#4469) · e2f51254
  Kris Hung authored Nov 19, 2025
  
  e2f51254
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- ci: TRT-LLM multimodal CI (#4118) · a8e5328e
  Indrajit Bhosale authored Nov 19, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  a8e5328e
- chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281) · 0b8b7ffb
  Kyle McGill authored Nov 19, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  0b8b7ffb
- chore: Unpinned accelerate version (#4458) · d01b6d2d
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: Kris Hung <krish@nvidia.com>
```
  d01b6d2d
- feat: nvext field to OpenAI APIs and add worker_id reporting (vLLM) (#4372) · 263f99dc
  Zhongxuan (Daniel) Wang authored Nov 18, 2025
```
Signed-off-by: Zhongxuan Wang <daniewang@nvidia.com>
```
  263f99dc
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
- feat: Request Cancellation when transitioning from Prefill to Decode at KV Prefill Router (#4449) · 04486c1d
  Jacky authored Nov 18, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  04486c1d
- fix: Allow users to set `--kv-transfer-config` for vLLM (#4317) · 45529d06
  Joe Chandler authored Nov 18, 2025
```
Signed-off-by: Joe Chandler <jchandler@glia-ai.com>
```
  45529d06
- docs: kvbm wheels doc fix (#4455) · 429ddf12
  Olga Andreeva authored Nov 18, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  429ddf12
18 Nov, 2025 3 commits
- fix: Recipe namespace fix (#4445) · c3195612
  atchernych authored Nov 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  c3195612
- feat: Support toolcall parser for DeepSeek V3 and R1 (#4253) · 164b0c29
  tangcy98 authored Nov 19, 2025
```
Signed-off-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
```
  164b0c29
- feat: Support a dynamic default max_tokens for VLLM backend (#4156) · 58405177
  bin.pan authored Nov 19, 2025
```
Signed-off-by: bin <bin.pan@daocloud.io>
```
  58405177