Commits · 91423c45b9d12fdda4a4f5a65534a84177f15509 · OpenDAS / dynamo

17 Dec, 2025 1 commit

feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483

Sean SH Choi authored Dec 17, 2025


Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

1c39e483

16 Dec, 2025 1 commit
- feat: video decoder in the frontend (#4719) · 74fcd4a9
  milesial authored Dec 16, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  74fcd4a9
15 Dec, 2025 2 commits
- fix: Fix kvbm nixl connector for vllm upgrade (#4957) · f26dbd09
  Kris Hung authored Dec 16, 2025
  
  f26dbd09
- chore: bump minijinja to 2.14.0 (#4949) · 24ac6c15
  KrishnanPrash authored Dec 15, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  24ac6c15
12 Dec, 2025 1 commit
- chore: enable local indexers for sglang and trtllm (#4932) · c2a29f80
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c2a29f80
11 Dec, 2025 5 commits
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- fix: relax pydantic requirements (#4865) · 2ef0f5fb
  Dmitry Tokarev authored Dec 11, 2025
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  2ef0f5fb
- feat: add cached tokens prometheus metric (#4534) · f8bb53c0
  Vladislav Nosivskoy authored Dec 11, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f8bb53c0
- test: Ensure Request Cancellation, Migration, Rejection Work with TCP transport (#4875) · 00f8615e
  Jacky authored Dec 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  00f8615e
09 Dec, 2025 2 commits
- feat: nixl_connect: Improve Concurrency Support (#4433) · 96fe63fe
  J Wyman authored Dec 09, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
```
  96fe63fe
- fix: add timeout to tests before lora to unblock (#4808) · 1e37c103
  Keiven C authored Dec 08, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  1e37c103
06 Dec, 2025 1 commit
- test: add timeout for lora utils tests (#4781) · 5588d770
  Biswa Panda authored Dec 05, 2025
  
  5588d770
05 Dec, 2025 1 commit
- feat: Add python-configurable engine routes for sglang profiling (#4617) · 3bc129dc
  William Arnold authored Dec 05, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  3bc129dc
04 Dec, 2025 3 commits
- fix: skip HuggingFace download for non-llms (#4686) · 118323f2
  Neal Vaidya authored Dec 04, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  118323f2
- fix: vLLM xfer bug (#4745) · 173201f5
  Alec authored Dec 04, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  173201f5
- chore: no need to arc wrap client (#4741) · 5b24b429
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5b24b429
03 Dec, 2025 1 commit
- chore: bump vLLM to 0.11.2 (#4476) · 60feb955
  Karen Chung authored Dec 03, 2025
  
  60feb955
02 Dec, 2025 3 commits
- feat: Extend the KV Event Consolidator to support TensorRT-LLM (#4533) · 6067c59d
  Kris Hung authored Dec 02, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  6067c59d
- feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
  Biswa Panda authored Dec 02, 2025
  
  71f94eda
- feat: dynamic setting of thresholds for rejection (#4673) · 4c1bc4ee
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c1bc4ee
01 Dec, 2025 1 commit
- fix: Page-align O_DIRECT writes for Lustre compatibility (#4508) · 5d9fc858
  Olga Andreeva authored Dec 01, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  5d9fc858
26 Nov, 2025 1 commit
- feat: add LoRA common APIs and implementation for lora management (#4464) · 6a0e67ed
  Biswa Panda authored Nov 26, 2025
  
  6a0e67ed
25 Nov, 2025 3 commits

refactor(storage): Remove the stuttering from key_value_store. (#4604) · fcb91e4b
Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
fcb91e4b

feat: decoded media via NIXL (#3988) · 0a065918

milesial authored Nov 25, 2025


Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>

0a065918

refactor(llm): Rename EngineConfig::Static to InProcess (#4585) · 0fc5273c
Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
0fc5273c

21 Nov, 2025 3 commits
- fix(storage): Correctly encoding FileStore keys (#4539) · 27904535
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  27904535
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
- chore: parallelize planner profile tests + bindings test cleanup (#4532) · d821a8b9
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d821a8b9
20 Nov, 2025 3 commits
- chore: Use general engine source for KVBM KV events (#4515) · 2f18b23e
  Kris Hung authored Nov 20, 2025
  
  2f18b23e
- chore: Remove DistributedRuntime::etcd_client (#4489) · 8a14f9ed
  Graham King authored Nov 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8a14f9ed
- feat: Report KVBM cache hit rate (#4333) · b2605a8e
  Kris Hung authored Nov 19, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  b2605a8e
19 Nov, 2025 6 commits
- feat: unregister discovery instance (#4459) · 781331c6
  Biswa Panda authored Nov 19, 2025
  
  781331c6
- fix: Revert "feat: kvbm kernels (#4356)" (#4467) · c2cc9782
  Dmitry Tokarev authored Nov 19, 2025
  
  c2cc9782
- feat: Only monitor NATS metrics if using NATS request plane (#4442) · 69797b5a
  Graham King authored Nov 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  69797b5a
- chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281) · 0b8b7ffb
  Kyle McGill authored Nov 19, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  0b8b7ffb
- feat: generate deterministic lora id from lora name (#4457) · 684107c4
  Biswa Panda authored Nov 18, 2025
  
  684107c4
- docs: kvbm wheels doc fix (#4455) · 429ddf12
  Olga Andreeva authored Nov 18, 2025
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
```
  429ddf12
18 Nov, 2025 2 commits
- fix(storage): File store shouldn't notify on metdata changes (#4434) · 2f1778c1
  Graham King authored Nov 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  2f1778c1
- feat: nixl_connect: Change the way `bytes` are passed to NIXL (#4314) · 08146531
  J Wyman authored Nov 18, 2025
```
Signed-off-by: J Wyman <jwyman@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  08146531