Commits · 2fe37a51320603ebd7f70993f36f69fe13efb86f · OpenDAS / dynamo

25 Mar, 2026 1 commit

fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51

huitian bai authored Mar 25, 2026


Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

2fe37a51

23 Mar, 2026 1 commit
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
17 Mar, 2026 3 commits
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
- feat(kv-router): plumb medium into worker-side placements (#7462) · e811db50
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e811db50
- feat: Concurrent KV event consumer (#7293) · 7ff5e0be
  jthomson04 authored Mar 17, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  7ff5e0be
11 Mar, 2026 1 commit

feat: follow up of optinal, batching-of-client-side-events (#6741) · fca0a801

Michael Feil authored Mar 11, 2026

Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <michaelfeil@users.noreply.github.com>
Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>

fca0a801

04 Mar, 2026 2 commits
- chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870) · b94cb543
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  b94cb543
- feat(kv-indexer): multi-model and multi-tenant isolation (#6830) · 35f99f93
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  35f99f93
02 Mar, 2026 1 commit
- feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) · 07742cc2
  Yan Ru Pei authored Mar 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  07742cc2
28 Feb, 2026 1 commit
- feat: dynamic batching of client side events (#6733) · 713c96d2
  Michael Feil authored Feb 28, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  713c96d2
24 Feb, 2026 1 commit
- feat: make KV cache events and routing LoRA-aware (#6517) · 75fea787
  Biswa Panda authored Feb 24, 2026
  
  75fea787
14 Feb, 2026 1 commit

feat: mm aware routing for vllm (#6235) · 815b1291

zhongdaor-nv authored Feb 13, 2026


Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>

815b1291

12 Feb, 2026 1 commit

feat: Flash Indexer (#5785) · 937398cf

Yan Ru Pei authored Feb 11, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

937398cf

03 Feb, 2026 1 commit
- feat: per dp rank gap detection (#5873) · 902eabd9
  Yan Ru Pei authored Feb 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  902eabd9
02 Feb, 2026 1 commit

fix: enable DP attention KV events for multi-node deployments (#5589) · c5f5ab60

ishandhanani authored Feb 02, 2026


Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: huitianbai <huitianbai@gmail.com>
Co-authored-by: Huitianqi Bai <huitianbai@users.noreply.github.com>

c5f5ab60

29 Jan, 2026 3 commits
- chore: consistently used the arc shared workers configs + CI flake fixes (#5707) · 584020f4
  Yan Ru Pei authored Jan 29, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  584020f4
- feat: remove deprecated events api (#5778) · 1174c819
  Biswa Panda authored Jan 28, 2026
  
  1174c819
- chore: clean ups in kv-router (#5771) · fc92fc18
  Yan Ru Pei authored Jan 28, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fc92fc18
27 Jan, 2026 2 commits
- chore: Fix tests logging setup (#5693) · 90b07594
  Graham King authored Jan 27, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  90b07594
- feat: add ZMQ transport and its discovery (#5625) · 8fc70f20
  Biswa Panda authored Jan 26, 2026
  
  8fc70f20
24 Jan, 2026 2 commits

chore(deps): bump vLLM to 0.14.0 (#5593) · 50f1e0e1

Alec authored Jan 23, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

50f1e0e1

docs: add NIXL backend configuration and fix multiple typos (#5564) · 912a4d4b

Abhishek Gupta authored Jan 23, 2026



Signed-off-by: Abhishek Kumar Gupta (AbhiOnGithub)
Signed-off-by: Abhishek Kumar Gupta <mail2abhishekgupta@gmail.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>

912a4d4b

23 Jan, 2026 1 commit
- chore: nuke ForwardPassMetrics (#5531) · feb6d272
  Yan Ru Pei authored Jan 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb6d272
15 Jan, 2026 1 commit
- feat: [router] serve worker KV query over dynamo endpoint instead of nats (#5451) · 7ebd5f82
  Biswa Panda authored Jan 15, 2026
  
  7ebd5f82
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

19 Dec, 2025 1 commit
- feat: add multimodal support to KV router with standalone trtllm example (#4577) · 481dc636
  zhongdaor-nv authored Dec 18, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  481dc636
17 Dec, 2025 1 commit
- fix: make gap detection work e2e (#4993) · 0fba01c2
  Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0fba01c2
12 Dec, 2025 1 commit
- feat: support decentralized router with NATs core (#4921) · ef3027bd
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ef3027bd
11 Dec, 2025 2 commits
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
03 Dec, 2025 1 commit
- test: remove redundant mocker e2e test in rust (#4720) · 77841e7b
  Yan Ru Pei authored Dec 03, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  77841e7b
02 Dec, 2025 1 commit
- feat: Extend the KV Event Consolidator to support TensorRT-LLM (#4533) · 6067c59d
  Kris Hung authored Dec 02, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  6067c59d
17 Nov, 2025 1 commit

refactor: centralize environment variable constants (#4083) · 0e77d344

Keiven C authored Nov 17, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

0e77d344

10 Nov, 2025 1 commit
- refactor: Make the Runtime and DistributedRuntime fields private (#4193) · cf630bf7
  Graham King authored Nov 10, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  cf630bf7
01 Nov, 2025 1 commit
- feat: efficient serving of multiple mockers (#3997) · 6ff49edb
  Yan Ru Pei authored Oct 31, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6ff49edb
31 Oct, 2025 1 commit
- fix: remove metric publisher tight loop (#4028) · e5c109d8
  Yan Ru Pei authored Oct 31, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e5c109d8
28 Oct, 2025 2 commits
- feat: mocker disagg (#3833) · cc4c3516
  Yan Ru Pei authored Oct 28, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cc4c3516
- chore(runtime): Do not expose etcd lease ID (#3915) · c78b5901
  Graham King authored Oct 28, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c78b5901
24 Oct, 2025 1 commit

refactor: redesign the metrics API from Trait to composition to make the code... · cbe0b177

Keiven C authored Oct 24, 2025


refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

cbe0b177