Commits · d712ce8d0df3b74e020153016c509f249c679d20 · OpenDAS / dynamo

21 Oct, 2025 1 commit
- feat: bake prefill router into frontend, supporting vllm for now (#3762) · e01c6e99
  Yan Ru Pei authored Oct 21, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e01c6e99
16 Oct, 2025 2 commits
- docs: reorganizing documentation to make things clearer (#3658) · 598cbbb7
  Anish authored Oct 16, 2025
```
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
```
  598cbbb7
- docs: move SGLang and vLLM Prometheus metrics documentation to docs path (#3677) · f4cd71f3
  Keiven C authored Oct 16, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  f4cd71f3
15 Oct, 2025 1 commit
- fix: Reduce memory usage to avoid vLLM dsr1 OOM (#3660) · 29f5b822
  Kris Hung authored Oct 15, 2025
  
  29f5b822
11 Oct, 2025 1 commit

feat: add SGLang and vLLM passthrough metrics on Dynamo backend worker (#3539) · 55e458d8

Keiven C authored Oct 10, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

55e458d8

10 Oct, 2025 1 commit

docs: move all md files from components to docs (#3440) · 0a2a820b

Anant Sharma authored Oct 09, 2025


Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

0a2a820b

09 Oct, 2025 3 commits
- docs: add vLLM KVBM 2P2D example due to a special ENV VAR to note (#3526) · 44012a24
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  44012a24
- chore: add sample KVBM related k8s deployment manifests (#3523) · 5f7c1f7e
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  5f7c1f7e
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
08 Oct, 2025 2 commits
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- fix: update dynamo namespace env var usage (#3477) · 552146f2
  Biswa Panda authored Oct 08, 2025
  
  552146f2
07 Oct, 2025 1 commit

feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7

Hongkuan Zhou authored Oct 07, 2025


feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

83e259a7

03 Oct, 2025 1 commit

docs: add Planner Quickstart doc (#3358) · 89cf9107

hhzhang16 authored Oct 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

89cf9107

02 Oct, 2025 1 commit
- fix: correctly parse subcomponent in sla-planner + deploy/doc update (#3363) · cfe74445
  Hongkuan Zhou authored Oct 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cfe74445
01 Oct, 2025 3 commits
- feat: restructure source code for python packaging (#3201) · 836d7417
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  836d7417
- feat: Add vLLM compilation cache to Dynamo Operator (#3257) · fcc42624
  Michael Shin authored Oct 01, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fcc42624
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
30 Sep, 2025 2 commits
- fix: fix the lmcache args in the agg_lmcache.sh script (#3325) · 1a6eb099
  Richard Huo authored Sep 30, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  1a6eb099
- fix: fail fast custom template not found & more verbose vllm engine error (#3278) · 97fee502
  Chia-Wei authored Sep 30, 2025
```
Signed-off-by: Chia-Wei Chen <cchen562@wisc.edu>
```
  97fee502
29 Sep, 2025 2 commits
- feat: use python3 in all examples (#3259) · a01b7992
  Julien Mancuso authored Sep 29, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  a01b7992
- feat: add subComponentType in DGD API and uptake in planner (#3200) · 1a5016b0
  Thomas Montfort authored Sep 29, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  1a5016b0
26 Sep, 2025 1 commit
- docs: Add gpt-oss guide with reasoning / tool calling for vLLM and SGLang (#3219) · e2444577
  GuanLuo authored Sep 26, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  e2444577
24 Sep, 2025 2 commits
- fix: update the tags for consistency and remove 0.4.1 refs (#3058) · 9e8f67ed
  Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9e8f67ed
- feat: update planner manifests for Grove support (#3203) · 8bc2191e
  Thomas Montfort authored Sep 24, 2025
  
  8bc2191e
23 Sep, 2025 3 commits
- feat: add trtllm and vllm multinode k8s examples (#3100) · 37bc8444
  Julien Mancuso authored Sep 23, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  37bc8444
- feat: revamp kubernetes doc (#3173) · 4a718028
  Julien Mancuso authored Sep 23, 2025
```
Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  4a718028
- feat: Enable vLLM abort while engine is generating the next token (#3102) · 8bb9a555
  Jacky authored Sep 23, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  8bb9a555
22 Sep, 2025 2 commits
- feat: vllm prefill router (#3155) · 031590fc
  Yan Ru Pei authored Sep 22, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  031590fc
- feat: vllm. Use prefill-specific health check payload and use bos as token_id (#3126) · 6a612a66
  Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  6a612a66
19 Sep, 2025 2 commits
- fix: small planner manifest/doc fixes (#3129) · 7d2fc13e
  Thomas Montfort authored Sep 19, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  7d2fc13e
- feat: Port vllm port allocator to Rust in bindings (#3125) · 3865a941
  Graham King authored Sep 19, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  3865a941
18 Sep, 2025 2 commits

feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2

Chi McIsaac authored Sep 18, 2025

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

3b6dbef2

chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
b6595e24

17 Sep, 2025 2 commits
- fix: resolve token loss bug in final packet (#2985) · 045b61dd
  Xuwei authored Sep 17, 2025
```
Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>
```
  045b61dd
- feat: Canary Health Check. (#2903) · 08cb08c1
  Tzu-Ling Kan authored Sep 16, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  08cb08c1
09 Sep, 2025 4 commits
- docs: fix broken links (#2965) · 3ea3d59b
  nv-nmailhot authored Sep 09, 2025
  
  3ea3d59b
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
- feat: automatically setup and inject prometheus configuration (#2912) · 729b5fd5
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  729b5fd5
08 Sep, 2025 1 commit
- refactor: standardize e2e tests across 3 frameworks (#2827) · 93208162
  Alec authored Sep 08, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  93208162