Commits · b24ccd2906c9d60f54554c8c41727ae71f0a8b9b · OpenDAS / dynamo

11 Dec, 2025 1 commit
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
02 Dec, 2025 1 commit
- feat: dynamic setting of thresholds for rejection (#4673) · 4c1bc4ee
  Yan Ru Pei authored Dec 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4c1bc4ee
21 Nov, 2025 1 commit
- chore: merge KvIndexer and ApproxKvIndexer (#4500) · c61e0dd3
  Yan Ru Pei authored Nov 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c61e0dd3
05 Nov, 2025 1 commit
- docs: disagg router docs update (#4093) · 17af7a0f
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  17af7a0f
22 Oct, 2025 1 commit

docs: address Harry/VDR feedback + fixing broken links across repository (#3802) · c6b59045

Anish authored Oct 22, 2025


Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

c6b59045

21 Oct, 2025 1 commit
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
17 Oct, 2025 1 commit
- docs: briefly describe KV router limitations (#3716) · 4116e389
  Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4116e389
16 Oct, 2025 4 commits
- docs: reorganizing documentation to make things clearer (#3658) · 598cbbb7
  Anish authored Oct 16, 2025
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
```
  598cbbb7
- test: add durable consumer count test to CI using py-nats (#3669) · fdcc8d5b
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fdcc8d5b
- chore: move worker_monitor to the llm crate (#3667) · 7aa8e0e6
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7aa8e0e6
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
11 Oct, 2025 1 commit

chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6

Yan Ru Pei authored Oct 10, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

c3fcfdd6

08 Oct, 2025 1 commit
- docs: backend engines do not need to emit deterministic blocks (#3484) · 3aeae151
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aeae151
01 Oct, 2025 1 commit
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
30 Sep, 2025 1 commit
- fix: KV Router bindings docs (#3308) · f0041782
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f0041782
29 Sep, 2025 1 commit
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
25 Sep, 2025 2 commits
- docs: some router-related doc fixes for 0.5.1 release (#3232) · a69efbd1
  Yan Ru Pei authored Sep 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a69efbd1
- docs: make router docs mermaid texts green (#3221) · 818c2642
  Yan Ru Pei authored Sep 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  818c2642
24 Sep, 2025 1 commit
- docs: mermaid diagrams showcasing various KV router features (#3184) · d54f6fe8
  Yan Ru Pei authored Sep 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d54f6fe8
19 Sep, 2025 1 commit

feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b

Yan Ru Pei authored Sep 19, 2025


feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

5b19a39b

18 Sep, 2025 1 commit

feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2

Chi McIsaac authored Sep 18, 2025

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

3b6dbef2

03 Sep, 2025 1 commit
- feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
  Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  383e3b3a
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 1 commit
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
07 Aug, 2025 2 commits
- docs: fix lowest cost mistake in doc (#2361) · f7e468c7
  Yan Ru Pei authored Aug 07, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  f7e468c7
- feat: Router replicas with state-sharing (#2264) · 5166a3dd
  Yan Ru Pei authored Aug 07, 2025
  
  5166a3dd
23 Jul, 2025 1 commit
- docs: Update docs for new UX (#2070) · 3c500ae7
  Graham King authored Jul 23, 2025
  
  3c500ae7
08 Jul, 2025 1 commit

feat: predictive active blocks for routing without load metrics (#1731) · 84e71e27

Yan Ru Pei authored Jul 08, 2025


Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

84e71e27

30 May, 2025 1 commit
- refactor: rename KvMetricsPublisher to WorkerMetricsPublisher (#1284) · 2f8da9ad
  Alec authored May 30, 2025
  
  2f8da9ad
21 May, 2025 1 commit

docs: Add sphinx-theme based userguides (#528) · 8d636ebd

Suman Tatiraju authored May 21, 2025


Signed-off-by: Suman Tatiraju <167138127+statiraju@users.noreply.github.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: Suman Tatiraju <statiraju@statiraju-mlt.client.nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>

8d636ebd

18 Mar, 2025 1 commit
- docs: update guides and filenames (#252) · c2a6b368
  Suman Tatiraju authored Mar 17, 2025
  
  c2a6b368
17 Mar, 2025 2 commits

docs: add disclaimer about examples (#236) · e1553c39

Alec authored Mar 17, 2025


Co-authored-by: Harrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>

e1553c39

docs: first draft kv-router doc (#228) · d788b63e

Alec authored Mar 17, 2025

Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Sean <choishsean@gmail.com>
Co-authored-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>

d788b63e