Commits · 3c7ed61d05d153075b46d3a5e278c7d72c76f8e1 · OpenDAS / dynamo

31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

24 Dec, 2025 1 commit
- feat: KVBM Object Support - add runtime vars for object (#5063) · 096699c4
  Patrick authored Dec 23, 2025
```
Signed-off-by: Patrick Riel <priel@nvidia.com>
```
  096699c4
23 Dec, 2025 1 commit
- feat(dep-715): refactor helm directory and remove reference to cloud (#5042) · 3057af00
  Thomas Montfort authored Dec 23, 2025
  
  3057af00
22 Dec, 2025 1 commit
- fix: Client reconcile available instances from instance source periodically (#5043) · 88abc787
  Jacky authored Dec 22, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  88abc787
19 Dec, 2025 2 commits
- feat: Request Migration Metrics (#5029) · e6a6a1f2
  Jacky authored Dec 19, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e6a6a1f2
- fix: support dynamic metadata updates in Kubernetes backed discovery (#4988) · 4106b90f
  mohammedabdulwahhab authored Dec 19, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  4106b90f
18 Dec, 2025 3 commits
- feat: switch to tcp as default request plane (#4845) · 18b64e90
  Biswa Panda authored Dec 18, 2025
  
  18b64e90
- feat: propagate trace context to vLLM engine (#4918) · b401a1d6
  jh-nv authored Dec 18, 2025
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  b401a1d6
- feat(frontend): First part of Python request handling (#4999) · da0f2fb8
  Graham King authored Dec 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  da0f2fb8
16 Dec, 2025 2 commits
- feat: graceful exit leading to 500 and connection errors -... · 54dcf3ad
  Michael Feil authored Dec 16, 2025
```
feat: graceful exit leading to 500 and connection errors - liveness-return-false if-cancelled (#4914)
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  54dcf3ad
- chore: do not assume QUEUE_NAME for event stream anymore (#4982) · 59e6873e
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  59e6873e
13 Dec, 2025 1 commit
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
12 Dec, 2025 1 commit
- fix: health check race condition by waiting for watch stream discovery (#4876) · 32bfc0f3
  Tzu-Ling Kan authored Dec 11, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  32bfc0f3
11 Dec, 2025 5 commits
- feat: use os assigned free port for tcp rpc (#4891) · 64a30d3d
  Biswa Panda authored Dec 11, 2025
  
  64a30d3d
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
- test: graceful shutdown for tcp req plane (#4883) · 5e96c9a8
  Biswa Panda authored Dec 11, 2025
  
  5e96c9a8
- feat: add cached tokens prometheus metric (#4534) · f8bb53c0
  Vladislav Nosivskoy authored Dec 11, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f8bb53c0
- fix: worker to graceful shutdown after finishing in-flight requests (#4838) · c8845b41
  Hongkuan Zhou authored Dec 10, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  c8845b41
09 Dec, 2025 3 commits
- feat: Disable health checks by default; auto-enable in K8s via operator (#4804) · 7c15166d
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  7c15166d
- feat: Change health check log level from info to debug (#4818) · 1f9b69b0
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  1f9b69b0
- fix: Fix warning messages with healthcheck (#4793) · bd4366d0
  jthomson04 authored Dec 08, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  bd4366d0
05 Dec, 2025 2 commits
- fix: use channel to avoid race condition from async nats registration task (#4758) · 501ef021
  Biswa Panda authored Dec 05, 2025
  
  501ef021
- feat: Add python-configurable engine routes for sglang profiling (#4617) · 3bc129dc
  William Arnold authored Dec 05, 2025
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  3bc129dc
04 Dec, 2025 2 commits
- refactor: remove legacy NATS metrics and stats_handler (#4680) · 00b64ae0
  Keiven C authored Dec 04, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  00b64ae0
- feat: Turn on canary health check by default (#4368) · d5800311
  Tzu-Ling Kan authored Dec 03, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  d5800311
03 Dec, 2025 2 commits

chore: Arc wrap prometheus_registry in MetricsRegistry (#4677) · c5e8c4c2
Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
c5e8c4c2

fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port... · 3cad926e

Keiven C authored Dec 02, 2025

fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port binding, and update etcd test (#4687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

3cad926e

02 Dec, 2025 2 commits
- fix(FileStore): Stop keep-alive thread on cancellation token. (#4666) · c9fdc2ea
  Graham King authored Dec 02, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c9fdc2ea
- feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644) · 71f94eda
  Biswa Panda authored Dec 02, 2025
  
  71f94eda
26 Nov, 2025 2 commits
- fix: allow router to be registered as general transport type (#4633) · ea9d00e7
  Yan Ru Pei authored Nov 26, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ea9d00e7
- feat: add LoRA common APIs and implementation for lora management (#4464) · 6a0e67ed
  Biswa Panda authored Nov 26, 2025
  
  6a0e67ed
25 Nov, 2025 4 commits
- refactor(storage): Remove the stuttering from key_value_store. (#4604) · fcb91e4b
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  fcb91e4b
- chore: make router use the discovery pattern instead of manual kv watch (#4597) · 9c5018e5
  Yan Ru Pei authored Nov 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9c5018e5
- chore(runtime): Make nats_client private, refactor NATS stats scraping (#4591) · 17dcffe8
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  17dcffe8
- chore(runtime): Tidy up component paths (#4560) · 51c1b9f1
  Graham King authored Nov 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  51c1b9f1
24 Nov, 2025 1 commit
- fix(dynamo-run): Run without etcd/nats, HTTP port to 8000 (#4555) · e75bcf67
  Graham King authored Nov 24, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e75bcf67
22 Nov, 2025 1 commit
- fix: health check endpoint (#4522) · b1286e7f
  Biswa Panda authored Nov 21, 2025
  
  b1286e7f
21 Nov, 2025 2 commits
- chore: Make nats_client private at crate level, various tidy up (#4513) · f05f7629
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f05f7629
- fix(storage): Correctly encoding FileStore keys (#4539) · 27904535
  Graham King authored Nov 21, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  27904535
20 Nov, 2025 1 commit
- chore: Remove DistributedRuntime::etcd_client (#4489) · 8a14f9ed
  Graham King authored Nov 20, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  8a14f9ed