Commits · 332499458b775d89aa98ce29ef74a465f3c62523 · OpenDAS / dynamo · GitLab

11 Dec, 2025 5 commits
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- fix: relax pydantic requirements (#4865) · 2ef0f5fb
  Dmitry Tokarev authored Dec 11, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  2ef0f5fb
- feat: add cached tokens prometheus metric (#4534) · f8bb53c0
  Vladislav Nosivskoy authored Dec 11, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f8bb53c0
- test: Ensure Request Cancellation, Migration, Rejection Work with TCP transport (#4875) · 00f8615e
  Jacky authored Dec 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  00f8615e
09 Dec, 2025 2 commits
- feat: nixl_connect: Improve Concurrency Support (#4433) · 96fe63fe
  J Wyman authored Dec 09, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
```
  96fe63fe
- fix: add timeout to tests before lora to unblock (#4808) · 1e37c103
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1e37c103
06 Dec, 2025 1 commit
- test: add timeout for lora utils tests (#4781) · 5588d770
  Biswa Panda authored Dec 05, 2025
  
  5588d770
05 Dec, 2025 1 commit
- feat: Add python-configurable engine routes for sglang profiling (#4617) · 3bc129dc
  William Arnold authored Dec 05, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  3bc129dc
04 Dec, 2025 1 commit
- fix: skip HuggingFace download for non-llms (#4686) · 118323f2
  Neal Vaidya authored Dec 04, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  118323f2
02 Dec, 2025 1 commit
- feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
  Biswa Panda authored Dec 02, 2025
  
  71f94eda
26 Nov, 2025 1 commit
- feat: add LoRA common APIs and implementation for lora management (#4464) · 6a0e67ed
  Biswa Panda authored Nov 26, 2025
  
  6a0e67ed
25 Nov, 2025 3 commits

refactor(storage): Remove the stuttering from key_value_store. (#4604) · fcb91e4b
Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
fcb91e4b

feat: decoded media via NIXL (#3988) · 0a065918

milesial authored Nov 25, 2025


Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

0a065918

refactor(llm): Rename EngineConfig::Static to InProcess (#4585) · 0fc5273c
Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
0fc5273c

21 Nov, 2025 3 commits
- fix(storage): Correctly encoding FileStore keys (#4539) · 27904535
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  27904535
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- chore: parallelize planner profile tests + bindings test cleanup (#4532) · d821a8b9
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d821a8b9
20 Nov, 2025 2 commits
- chore: Use general engine source for KVBM KV events (#4515) · 2f18b23e
  Kris Hung authored Nov 20, 2025
  
  2f18b23e
- chore: Remove DistributedRuntime::etcd_client (#4489) · 8a14f9ed
  Graham King authored Nov 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8a14f9ed
19 Nov, 2025 3 commits
- feat: unregister discovery instance (#4459) · 781331c6
  Biswa Panda authored Nov 19, 2025
  
  781331c6
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
18 Nov, 2025 3 commits
- fix(storage): File store shouldn't notify on metdata changes (#4434) · 2f1778c1
  Graham King authored Nov 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2f1778c1
- feat: nixl_connect: Change the way `bytes` are passed to NIXL (#4314) · 08146531
  J Wyman authored Nov 18, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  08146531
- feat: mocker can use planner profile data (#4422) · fc2ad4eb
  Yan Ru Pei authored Nov 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  fc2ad4eb
17 Nov, 2025 2 commits
- refactor: centralize environment variable constants (#4083) · 0e77d344
  Keiven C authored Nov 17, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  0e77d344
- feat: Command line flag to set request plane mode: tcp, http or nats (#4365) · 886506c1
  Graham King authored Nov 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  886506c1
14 Nov, 2025 1 commit
- fix(router): change prune channel to be mpsc instead of watch, increase max size (#4351) · 2cf427ed
  Waël Boukhobza authored Nov 14, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  2cf427ed
13 Nov, 2025 3 commits
- chore: better error handling in prefill router (#4286) · ce833983
  Yan Ru Pei authored Nov 13, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ce833983
- feat: transport agnostic request plane for dynamo - natless (#4246) · 06b0ebef
  Biswa Panda authored Nov 13, 2025
  
  06b0ebef
- feat: kv router should route to available instances (#4225) · 8379b0cd
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8379b0cd
12 Nov, 2025 2 commits
- chore: use notify instead of inotify (#4250) · 38242c8d
  Yan Ru Pei authored Nov 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38242c8d
- feat(router): max tree size based pruning (#4057) · 3ea22fcf
  Waël Boukhobza authored Nov 12, 2025
```
Signed-off-by: Wael Boukhobza <wawa_wael@live.fr>
```
  3ea22fcf
11 Nov, 2025 3 commits
- chore: Remove the python bindings for port allocation (#4237) · fbad2860
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fbad2860
- chore: Remove static mode (#4235) · e1af3af6
  Graham King authored Nov 11, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e1af3af6
- feat: Add output token counter to frontend metrics (#4202) · 8f868986
  Aryan Bagade authored Nov 10, 2025
```
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
```
  8f868986
10 Nov, 2025 3 commits
- fix: add kube impl for discovery and add metadata endpoint (#4136) · 7afb5431
  mohammedabdulwahhab authored Nov 10, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
```
  7afb5431
- fix: Extend add_tensor_model so that ModelDeploymentCard can be correctly picked up (#4169) · ec7af939
  zhongdaor-nv authored Nov 10, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  ec7af939
- chore: update versions for 0.7.0 release (#4217) · 23660bc5
  Anant Sharma authored Nov 10, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  23660bc5