Commits · e01c6e99bd5d9d0edf32560e274250d7c32e560f · OpenDAS / dynamo

21 Oct, 2025 1 commit
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
17 Oct, 2025 2 commits

docs: briefly describe KV router limitations (#3716) · 4116e389
Yan Ru Pei authored Oct 17, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
4116e389

docs: Add Kvbm documentation for connector API integrations [DYN-1052] (#3578) · 7ead8b71

Suman Tatiraju authored Oct 17, 2025

Signed-off-by: Suman Tatiraju <statiraju@nvidia.com>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>

7ead8b71

16 Oct, 2025 4 commits
- docs: reorganizing documentation to make things clearer (#3658) · 598cbbb7
  Anish authored Oct 16, 2025
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
```
  598cbbb7
- test: add durable consumer count test to CI using py-nats (#3669) · fdcc8d5b
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  fdcc8d5b
- chore: move worker_monitor to the llm crate (#3667) · 7aa8e0e6
  Yan Ru Pei authored Oct 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7aa8e0e6
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
11 Oct, 2025 1 commit

chore: consolidations of KvPushRouter bindings and usage examples (#3543) · c3fcfdd6

Yan Ru Pei authored Oct 10, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

c3fcfdd6

10 Oct, 2025 1 commit

docs: move all md files from components to docs (#3440) · 0a2a820b

Anant Sharma authored Oct 09, 2025


Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

0a2a820b

08 Oct, 2025 1 commit
- docs: backend engines do not need to emit deterministic blocks (#3484) · 3aeae151
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aeae151
03 Oct, 2025 1 commit

docs: add Planner Quickstart doc (#3358) · 89cf9107

hhzhang16 authored Oct 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

89cf9107

02 Oct, 2025 1 commit
- docs: Fix broken links (#3372) · e8cfbd7d
  Ryan McCormick authored Oct 02, 2025
  
  e8cfbd7d
01 Oct, 2025 1 commit
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
30 Sep, 2025 1 commit
- fix: KV Router bindings docs (#3308) · f0041782
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f0041782
29 Sep, 2025 1 commit
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
25 Sep, 2025 3 commits
- chore: Migrate planner virtual_connector internals into bindings (#3205) · c03e2f6b
  Graham King authored Sep 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c03e2f6b
- docs: some router-related doc fixes for 0.5.1 release (#3232) · a69efbd1
  Yan Ru Pei authored Sep 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a69efbd1
- docs: make router docs mermaid texts green (#3221) · 818c2642
  Yan Ru Pei authored Sep 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  818c2642
24 Sep, 2025 1 commit
- docs: mermaid diagrams showcasing various KV router features (#3184) · d54f6fe8
  Yan Ru Pei authored Sep 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d54f6fe8
23 Sep, 2025 1 commit

feat: revamp kubernetes doc (#3173) · 4a718028

Julien Mancuso authored Sep 23, 2025


Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

4a718028

19 Sep, 2025 1 commit

feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b

Yan Ru Pei authored Sep 19, 2025


feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

5b19a39b

18 Sep, 2025 1 commit

feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2

Chi McIsaac authored Sep 18, 2025

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

3b6dbef2

10 Sep, 2025 2 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
de5ab2c4

09 Sep, 2025 1 commit
- feat: add a virtual connector for 3rd party deployments (#2913) · 8543d0d3
  Hongkuan Zhou authored Sep 09, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  8543d0d3
05 Sep, 2025 1 commit
- docs: change docs to default port 8000 (#2876) · 1995ef9a
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1995ef9a
03 Sep, 2025 1 commit
- feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
  Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  383e3b3a
02 Sep, 2025 2 commits
- docs: add mention of deploy/utils quickstart to planner deployment docs (#2821) · a6e1d5fe
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a6e1d5fe
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 2 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
29 Aug, 2025 1 commit
- test: add tests for replica calculation and planner scaling (#2525) · 353ba5db
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  353ba5db
25 Aug, 2025 1 commit
- docs: Simplify sphinx build and table of contents on webpage (#2519) · 766d3f2c
  Ryan McCormick authored Aug 25, 2025
  
  766d3f2c
21 Aug, 2025 1 commit
- chore: remove circus dependency (#2602) · 28fb77cf
  Hongkuan Zhou authored Aug 21, 2025
  
  28fb77cf
19 Aug, 2025 1 commit
- docs: Consolidate documentation and fix redundant headings (#2518) · 129a2444
  Anish authored Aug 19, 2025
  
  129a2444
18 Aug, 2025 2 commits
- chore: add pre-deployment profiling results on H200 cluster to unblock planner testing (#2495) · dea0b201
  Hongkuan Zhou authored Aug 18, 2025
```
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
```
  dea0b201
- docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add... · 844f8819
  Ryan McCormick authored Aug 18, 2025
```
docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add lychee link checker github action (#2482)
```
  844f8819
15 Aug, 2025 1 commit
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
12 Aug, 2025 1 commit

feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68

Hongkuan Zhou authored Aug 12, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

b4189c68