Commits · 1e120ed049595195a66e3e004e404dff35239ed1 · OpenDAS / dynamo

"tests/vscode:/vscode.git/clone" did not exist on "2aab9acf48b5f10a4ee0b29f152fc497a46c956d"

14 Nov, 2025 6 commits
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
- fix(runtime): Handle dropping the tokio runtime in async context (#4343) · 611c213b
  Graham King authored Nov 14, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  611c213b
- refactor: migrate kvbm python bindings to the python directory (#4318) · 5a5bc51e
  Ryan Olson authored Nov 14, 2025
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  5a5bc51e
- fix: k8s native discovery (#4305) · 334ce551
  Thomas Montfort authored Nov 14, 2025
  
  334ce551
- chore: use hyphens for Router-related keys (#4325) · 065296c3
  Yan Ru Pei authored Nov 14, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  065296c3
- fix: Make lmcache dependency optional for PdConnector (#4319) · b2370a97
  Olga Andreeva authored Nov 14, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Signed-off-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  b2370a97
13 Nov, 2025 9 commits
- test(key_value_store): Assert entries() works correctly (#4312) · 58da7cfe
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  58da7cfe
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: Add vLLM multimodal audio support (#2760) · 0f5dd2b7
  Yuekai Zhang authored Nov 14, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  0f5dd2b7
- fix: kvbm defer logging init to after tokio runtime is available (#4123) · af26a013
  Anthony Casagrande authored Nov 13, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  af26a013
- feat(key_value_store): FileStore entries have a lease that auto-expires (#4301) · cdc9fa77
  Graham King authored Nov 13, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cdc9fa77
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
- chore: enlarge default KVBM leader-worker timeout and better wording (#4283) · 3fa8448b
  Ziqi Fan authored Nov 12, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  3fa8448b
- chore: router slot manager should not panic (#4267) · 1f44fca7
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1f44fca7
12 Nov, 2025 5 commits
- chore: make Router non-reliant on etcd (#4244) · 4d86f347
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4d86f347
- feat: tie break on tree size when routing (#4257) · 7d604dd3
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7d604dd3
- feat: KVBM V2 transfer (#4068) · 827b8c3e
  jthomson04 authored Nov 12, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  827b8c3e
- chore: use notify instead of inotify (#4250) · 38242c8d
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38242c8d
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
11 Nov, 2025 4 commits
- chore: Remove the python bindings for port allocation (#4237) · fbad2860
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fbad2860
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
- feat: Add output token counter to frontend metrics (#4202) · 8f868986
  Aryan Bagade authored Nov 10, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
```
  8f868986
- fix: remove remaining DYN_SYSTEM_ENABLED references (#4197) · 674e2eca
  Keiven C authored Nov 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  674e2eca
10 Nov, 2025 9 commits
- fix: add kube impl for discovery and add metadata endpoint (#4136) · 7afb5431
  mohammedabdulwahhab authored Nov 10, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
```
  7afb5431
- fix: Extend add_tensor_model so that ModelDeploymentCard can be correctly picked up (#4169) · ec7af939
  zhongdaor-nv authored Nov 10, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  ec7af939
- fix: KeyValueStore etcd impl should use internal etcd client (#4212) · f30d76ce
  Graham King authored Nov 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f30d76ce
- chore: update versions for 0.7.0 release (#4217) · 23660bc5
  Anant Sharma authored Nov 10, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  23660bc5
- feat: make NIXL descriptor serializable (#4222) · 2d6cc432
  milesial authored Nov 10, 2025
```
Signed-off-by: milesial <milesial@users.noreply.github.com>
```
  2d6cc432
- refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) · afccc9d4
  Keiven C authored Nov 10, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  afccc9d4
- chore: Improve prefill router error reporting and fix typo (#4220) · 3577b5c1
  Neelay Shah authored Nov 10, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  3577b5c1
- refactor: Make the Runtime and DistributedRuntime fields private (#4193) · cf630bf7
  Graham King authored Nov 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cf630bf7
- fix: Fix KVBM GPU memory leak (#4171) · 94fa72ca
  Kris Hung authored Nov 09, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  94fa72ca
08 Nov, 2025 6 commits
- fix: refactor to use service discovery (#4092) · 09b26bf6
  mohammedabdulwahhab authored Nov 08, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  09b26bf6
- fix: no more multiple finish reasons in stream (#4154) · 04f7579b
  Ayush Agarwal authored Nov 07, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  04f7579b
- fix: deserialize tool call args (#4176) · 51c4fe63
  ryan-lempka authored Nov 07, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  51c4fe63
- feat: Add support for skip_special_tokens parameter in v1/completions and... · 441473c3
  Ryan McCormick authored Nov 07, 2025
```
feat: Add support for skip_special_tokens parameter in v1/completions and v1/chat/completions endpoints (#4175)
```
  441473c3
- feat: Media decoder and fetcher options in the MDC (#4094) · 14af074e
  milesial authored Nov 07, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  14af074e
- fix(etcd): KeyValueStore etcd uses our client not the lib directly (#4199) · e17b0460
  Graham King authored Nov 07, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e17b0460
07 Nov, 2025 1 commit

feat: enable HTTP completion endpoint to accept arrays of prompts and generate... · 93ada899

zhongdaor-nv authored Nov 07, 2025


feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

93ada899