Commits · 9b9536d0d7929ad2cfd04d09f6f1ed23d145488f · OpenDAS / dynamo

"lib/llm/src/postprocessor/tool_calling/response.rs" did not exist on "4f6f63cd1692d1929bafac54232f608550719aa4"

01 Oct, 2025 1 commit
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
30 Sep, 2025 1 commit
- fix: KV Router bindings docs (#3308) · f0041782
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f0041782
29 Sep, 2025 1 commit
- fix: more fixes for stable router benchmarking (#3264) · 3aa30778
  Yan Ru Pei authored Sep 29, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  3aa30778
25 Sep, 2025 3 commits
- chore: Migrate planner virtual_connector internals into bindings (#3205) · c03e2f6b
  Graham King authored Sep 25, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  c03e2f6b
- docs: some router-related doc fixes for 0.5.1 release (#3232) · a69efbd1
  Yan Ru Pei authored Sep 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a69efbd1
- docs: make router docs mermaid texts green (#3221) · 818c2642
  Yan Ru Pei authored Sep 25, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  818c2642
24 Sep, 2025 1 commit
- docs: mermaid diagrams showcasing various KV router features (#3184) · d54f6fe8
  Yan Ru Pei authored Sep 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d54f6fe8
23 Sep, 2025 1 commit

feat: revamp kubernetes doc (#3173) · 4a718028

Julien Mancuso authored Sep 23, 2025


Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

4a718028

19 Sep, 2025 1 commit

feat: allow router to not track active blocks (prefill), and to not track... · 5b19a39b

Yan Ru Pei authored Sep 19, 2025


feat: allow router to not track active blocks (prefill), and to not track cached blocks (decode) (#3135)
Signed-off-by: PeaBrane <yanrpei@gmail.com>

5b19a39b

18 Sep, 2025 1 commit

feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2

Chi McIsaac authored Sep 18, 2025

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

3b6dbef2

10 Sep, 2025 2 commits

feat: support trtllm in sla-planner (#2980) · dcee4dbd

Hongkuan Zhou authored Sep 10, 2025


Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

dcee4dbd

docs: Python runtime Request Cancellation examples (#2893) · de5ab2c4
Jacky authored Sep 10, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
de5ab2c4

09 Sep, 2025 1 commit
- feat: add a virtual connector for 3rd party deployments (#2913) · 8543d0d3
  Hongkuan Zhou authored Sep 09, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  8543d0d3
05 Sep, 2025 1 commit
- docs: change docs to default port 8000 (#2876) · 1995ef9a
  Yan Ru Pei authored Sep 04, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1995ef9a
03 Sep, 2025 1 commit
- feat: don't modify kv scheduler states on query + more python binding (#2798) · 383e3b3a
  Yan Ru Pei authored Sep 02, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  383e3b3a
02 Sep, 2025 2 commits
- docs: add mention of deploy/utils quickstart to planner deployment docs (#2821) · a6e1d5fe
  hhzhang16 authored Sep 02, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  a6e1d5fe
- feat: FT Request Cancellation feature and test for 0.5.0 (#2500) · 6c539fbd
  Jacky authored Sep 02, 2025
  
  6c539fbd
01 Sep, 2025 1 commit
- fix: do not delete KV events jetstream (#2800) · 7fabe7bf
  Yan Ru Pei authored Sep 01, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fabe7bf
30 Aug, 2025 2 commits
- feat: Router warm restarts via durable KV event consumers and radix snapshotting (#2756) · 488c8709
  Yan Ru Pei authored Aug 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  488c8709
- feat: add benchmarking guide (#2620) · 699996e4
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  699996e4
29 Aug, 2025 1 commit
- test: add tests for replica calculation and planner scaling (#2525) · 353ba5db
  hhzhang16 authored Aug 29, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  353ba5db
25 Aug, 2025 1 commit
- docs: Simplify sphinx build and table of contents on webpage (#2519) · 766d3f2c
  Ryan McCormick authored Aug 25, 2025
  
  766d3f2c
21 Aug, 2025 1 commit
- chore: remove circus dependency (#2602) · 28fb77cf
  Hongkuan Zhou authored Aug 21, 2025
  
  28fb77cf
19 Aug, 2025 1 commit
- docs: Consolidate documentation and fix redundant headings (#2518) · 129a2444
  Anish authored Aug 19, 2025
  
  129a2444
18 Aug, 2025 2 commits
- chore: add pre-deployment profiling results on H200 cluster to unblock planner testing (#2495) · dea0b201
  Hongkuan Zhou authored Aug 18, 2025
```
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
```
  dea0b201
- docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add... · 844f8819
  Ryan McCormick authored Aug 18, 2025
```
docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add lychee link checker github action (#2482)
```
  844f8819
15 Aug, 2025 1 commit
- chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose... · 922850ae
  Hongkuan Zhou authored Aug 15, 2025
```
chore: bug fixes in pre-deployment sweeping and vllm_v1 planner; expose num_d/p to k8s metrics (#2454)
```
  922850ae
12 Aug, 2025 1 commit

feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68

Hongkuan Zhou authored Aug 12, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

b4189c68

11 Aug, 2025 1 commit
- feat: profiling PVC updates for better UX (#2402) · bea92eae
  hhzhang16 authored Aug 11, 2025
  
  bea92eae
07 Aug, 2025 2 commits
- docs: fix lowest cost mistake in doc (#2361) · f7e468c7
  Yan Ru Pei authored Aug 07, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  f7e468c7
- feat: Router replicas with state-sharing (#2264) · 5166a3dd
  Yan Ru Pei authored Aug 07, 2025
  
  5166a3dd
01 Aug, 2025 1 commit

test: Request Migration Docs and E2E vLLM Tests (#2177) · ae51b3f4

Jacky authored Aug 01, 2025


Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

ae51b3f4

29 Jul, 2025 4 commits
- chore: add instructions to modify SLA to profile_sla doc; update component name (#2167) · 157714aa
  Hongkuan Zhou authored Jul 29, 2025
  
  157714aa
- docs: Examples README/restructuring, framework READMEs, EKS examples (#2174) · 12a7b83b
  Anish authored Jul 29, 2025
  
  12a7b83b
- Readmes + eks additions (#2157) · 5be23eb7
  Anish authored Jul 29, 2025
  
  5be23eb7
- feat: deprecate sdk as dependency (#2149) · 47477909
  Biswa Panda authored Jul 28, 2025
  
  47477909
28 Jul, 2025 1 commit

feat: Deploy SLA planner to Kubernetes (#2135) · d23d48ba

hhzhang16 authored Jul 28, 2025


Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

d23d48ba

25 Jul, 2025 1 commit
- fix: move docker-compose.yml to deploy/, and update frontend port (#2121) · 4498a77d
  Keiven C authored Jul 25, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  4498a77d
24 Jul, 2025 1 commit

feat: deploy SLA profiler to k8s (#2030) · fe718fd2

hhzhang16 authored Jul 24, 2025


Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

fe718fd2

23 Jul, 2025 1 commit
- docs: Update docs for new UX (#2070) · 3c500ae7
  Graham King authored Jul 23, 2025
  
  3c500ae7