Commits · ebd06a1f320ac5ac23d979dc8ee53d419be2719b · OpenDAS / dynamo

20 Mar, 2026 1 commit
- feat(llm): unify user-facing priority hints (#7492) · ebd06a1f
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebd06a1f
06 Mar, 2026 1 commit
- docs: fix step numbering in router benchmarking guide (#6988) · 84de4e8b
  dagil-nvidia authored Mar 06, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  84de4e8b
05 Mar, 2026 1 commit
- docs(router): add tuning guideline for output block tracking (#6911) · 5139f688
  Yan Ru Pei authored Mar 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  5139f688
02 Mar, 2026 1 commit
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
25 Feb, 2026 1 commit

fix: guarantee RouterRequestMetrics availability & documentation updates (#6558) · ff06b17e

Keiven C authored Feb 25, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

ff06b17e

24 Feb, 2026 2 commits

feat: add --disaggregation-mode enum to vLLM backend (#6483) · 7893f268

Alec authored Feb 23, 2026


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

7893f268

fix: fold scheduling into queue so backpressure actually works (#6470) · 0cb1d733

Yan Ru Pei authored Feb 23, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

0cb1d733

20 Feb, 2026 1 commit
- feat: default kv-events-config to empty (align with vLLM defaults) (#6404) · 7bbacce1
  Alec authored Feb 19, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  7bbacce1
15 Feb, 2026 1 commit

feat: speculative prefill (#6230) · 4ede59a2

Yan Ru Pei authored Feb 15, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>

4ede59a2

13 Feb, 2026 1 commit

feat: router priority queue (#6010) · bc514fbe

Yan Ru Pei authored Feb 12, 2026


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

bc514fbe

12 Feb, 2026 1 commit
- docs: migrate Fern docs from fern/ into docs/ (#6206) · 39d645e5
  Jonathan Tong authored Feb 11, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
```
  39d645e5
06 Feb, 2026 2 commits

docs: cleanup of docs refactor for components, integrations, and features (#6019) · b19de4ed
dagil-nvidia authored Feb 05, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
b19de4ed

docs: Migrate router documentation to three-tier structure (#5979) · 80e7bafd

akshatha-k authored Feb 05, 2026


Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

80e7bafd

05 Feb, 2026 2 commits
- fix: ignore benchmarks pytest for now (#5983) · 50e17783
  Yan Ru Pei authored Feb 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  50e17783
- fix: e2e aiperf profiling on NAT dataset (#5990) · 88efa735
  Yan Ru Pei authored Feb 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  88efa735
18 Jan, 2026 1 commit
- feat: track output tokens / blocks in the Router (optional) (#5452) · 050906b5
  Yan Ru Pei authored Jan 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  050906b5
16 Jan, 2026 1 commit
- chore: make precentile plots in router benchmark (#5476) · d83ab662
  Yan Ru Pei authored Jan 16, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d83ab662
07 Jan, 2026 1 commit
- fix: Remove asymmetric --request-plane nats from run_engines.sh script (#5245) · 6306afa6
  Ryan McCormick authored Jan 07, 2026
  
  6306afa6
06 Jan, 2026 1 commit
- fix: assign unique ports per vLLM worker to avoid ZMQ bind conflicts (#5224) · 19b5917c
  Alec authored Jan 06, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  19b5917c
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 1 commit

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

18 Nov, 2025 1 commit

docs: Clean up incomplete recipes and clarify Kubernetes-only focus (#4159) · 88dfd1b3

Ben Hamm authored Nov 17, 2025


Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: atchernych <atchernych@nvidia.com>

88dfd1b3

05 Nov, 2025 2 commits
- chore: trtllm use unified frontend (#4097) · 9fa8125c
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9fa8125c
- docs: disagg router docs update (#4093) · 17af7a0f
  Yan Ru Pei authored Nov 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  17af7a0f
01 Nov, 2025 1 commit
- feat: efficient serving of multiple mockers (#3997) · 6ff49edb
  Yan Ru Pei authored Oct 31, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  6ff49edb
28 Oct, 2025 1 commit
- feat: mocker disagg (#3833) · cc4c3516
  Yan Ru Pei authored Oct 28, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cc4c3516
27 Oct, 2025 1 commit
- fix: pipe AI perf streaming output to terminal in rotuer benchmarking (#3905) · 8c8922b0
  Yan Ru Pei authored Oct 27, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8c8922b0
24 Oct, 2025 2 commits
- fix: add the proper flag for mooncake benchmarking on router (#3878) · ee275cbf
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ee275cbf
- refactor: move engine configs out of components directory (#3772) · 8354d325
  Anant Sharma authored Oct 24, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
```
  8354d325
23 Oct, 2025 2 commits
- docs: include router benchmarking results (#3856) · 4e496691
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4e496691
- chore: restructure mocker cli args handling, to include prefill/decode (#3847) · 41ff394f
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  41ff394f
22 Oct, 2025 2 commits

docs: address Harry/VDR feedback + fixing broken links across repository (#3802) · c6b59045

Anish authored Oct 22, 2025


Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

c6b59045

chore: no need to publish kv events for decode vllm worker (#3819) · fb294b90
Yan Ru Pei authored Oct 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
fb294b90

21 Oct, 2025 1 commit
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
16 Oct, 2025 3 commits
- fix: update invalid AIPerf scripts and parsing logic (#3675) · 333ee983
  Anthony Casagrande authored Oct 16, 2025
```
Signed-off-by: Anthony Casagrande <acasagrande@nvidia.com>
```
  333ee983
- feat: Replace genai-perf with aiperf (#3533) · 9f310225
  Harshini Komali authored Oct 16, 2025
```
Signed-off-by: lkomali <lkomali@nvidia.com>
```
  9f310225
- feat: dp rank routing (#3597) · f978f4d1
  Yan Ru Pei authored Oct 15, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f978f4d1
08 Oct, 2025 1 commit
- feat: prefill routing for trtllm (#3471) · f3987f6c
  Yan Ru Pei authored Oct 08, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3987f6c
01 Oct, 2025 1 commit
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
29 Sep, 2025 1 commit
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778