Commits · 5744548bdfd7ffe4ec3de15b3fc3b04b038ffda3 · OpenDAS / dynamo

11 Oct, 2025 1 commit

feat: add SGLang and vLLM passthrough metrics on Dynamo backend worker (#3539) · 55e458d8

Keiven C authored Oct 10, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

55e458d8

10 Oct, 2025 1 commit

docs: move all md files from components to docs (#3440) · 0a2a820b

Anant Sharma authored Oct 09, 2025


Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

0a2a820b

09 Oct, 2025 6 commits
- refactor: remove sglang config and util files from components (#3467) · 03bdced9
  Anant Sharma authored Oct 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  03bdced9
- feat: sglang prefill router + bump to `0.5.3` (#3498) · 51f65757
  ishandhanani authored Oct 09, 2025
  
  51f65757
- docs: add vLLM KVBM 2P2D example due to a special ENV VAR to note (#3526) · 44012a24
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  44012a24
- chore: add sample KVBM related k8s deployment manifests (#3523) · 5f7c1f7e
  Ziqi Fan authored Oct 09, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  5f7c1f7e
- chore: Remove clear_namespace script (#3519) · e9a71009
  Graham King authored Oct 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e9a71009
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
08 Oct, 2025 2 commits
- feat: enable KVBM to support PD disagg in Dynamo vLLM (#3352) · 9975cb9f
  Ziqi Fan authored Oct 08, 2025
```
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
```
  9975cb9f
- fix: update dynamo namespace env var usage (#3477) · 552146f2
  Biswa Panda authored Oct 08, 2025
  
  552146f2
07 Oct, 2025 5 commits
- feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7
  Hongkuan Zhou authored Oct 07, 2025
```
feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  83e259a7
- chore: update guide for reasoning & tool calling parser with gpt-oss on trtllm (#3262) · 55f7e637
  zhongdaor-nv authored Oct 07, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  55f7e637
- docs: Update trtllm multinode multimodal docs (#3369) · 04aafa9a
  Indrajit Bhosale authored Oct 07, 2025
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  04aafa9a
- chore: Clean up for sglang multimodal example (#3420) · ddbb4f50
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  ddbb4f50
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
06 Oct, 2025 1 commit
- refactor: clean up sglang apis [1/n] (#3432) · de5c39df
  ishandhanani authored Oct 06, 2025
  
  de5c39df
03 Oct, 2025 2 commits

fix: remove VSWA user prompts, since we need a lot more updates to get it working (#3404) · c48f49a4
Richard Huo authored Oct 03, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
c48f49a4

docs: add Planner Quickstart doc (#3358) · 89cf9107

hhzhang16 authored Oct 03, 2025


Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

89cf9107

02 Oct, 2025 3 commits
- fix: correctly parse subcomponent in sla-planner + deploy/doc update (#3363) · cfe74445
  Hongkuan Zhou authored Oct 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cfe74445
- fix: add a note for users to use VSWA feature after 0.5.1 release (#3380) · 92b8fe07
  Richard Huo authored Oct 02, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  92b8fe07
- feat: Add multimodal EPD for Sglang (#3230) · 62661cce
  Kris Hung authored Oct 01, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  62661cce
01 Oct, 2025 4 commits
- feat: restructure source code for python packaging (#3201) · 836d7417
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  836d7417
- feat: Add vLLM compilation cache to Dynamo Operator (#3257) · fcc42624
  Michael Shin authored Oct 01, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fcc42624
- feat: Add --custom-jinja-template argument to pass a custom chat template for TRTLLM (#3332) · b5782fcd
  KrishnanPrash authored Sep 30, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  b5782fcd
- feat: make prefill router general (#3329) · 9b9536d0
  Yan Ru Pei authored Sep 30, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  9b9536d0
30 Sep, 2025 8 commits
- feat: Add --custom-jinja-template argument to pass a custom chat template for SGLang (#3165) · f95ba894
  KrishnanPrash authored Sep 30, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f95ba894
- fix: fix the lmcache args in the agg_lmcache.sh script (#3325) · 1a6eb099
  Richard Huo authored Sep 30, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  1a6eb099
- chore: update slurm scrips for better warmup and bump sgl version (#3291) · 0ab6bc2b
  ishandhanani authored Sep 30, 2025
  
  0ab6bc2b
- refactor: Simplify TRT-LLM request abort calling logic (#3296) · 87190db0
  Jacky authored Sep 30, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  87190db0
- fix: Install right versions of the dependencies for tensorrtllm (#3218) · c265cd67
  Tanmay Verma authored Sep 30, 2025
  
  c265cd67
- fix: fail fast custom template not found & more verbose vllm engine error (#3278) · 97fee502
  Chia-Wei authored Sep 30, 2025
```
Signed-off-by: Chia-Wei Chen <cchen562@wisc.edu>
```
  97fee502
- refactor: standardize HF_CACHE to HF_HOME across codebase (use Hugging Face convention) (#3310) · 481bf395
  Keiven C authored Sep 30, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  481bf395
- fix: fix backend in trtllm multinode example (#3311) · 50dfd3af
  Julien Mancuso authored Sep 30, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  50dfd3af
29 Sep, 2025 2 commits
- feat: use python3 in all examples (#3259) · a01b7992
  Julien Mancuso authored Sep 29, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  a01b7992
- feat: add subComponentType in DGD API and uptake in planner (#3200) · 1a5016b0
  Thomas Montfort authored Sep 29, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  1a5016b0
26 Sep, 2025 3 commits
- docs: Add gpt-oss guide with reasoning / tool calling for vLLM and SGLang (#3219) · e2444577
  GuanLuo authored Sep 26, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  e2444577
- feat: Request Cancellation TRT-LLM (#3193) · 77e66ae5
  Jacky authored Sep 26, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  77e66ae5
- docs: remove prebuilt TRT-LLM requirement in gpt-oss guide (#3234) · da7d1a33
  GuanLuo authored Sep 26, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  da7d1a33
25 Sep, 2025 1 commit
- feat: update how we wait for model before model is ready (#3050) · e1c7a4a4
  Yunzhou Liu authored Sep 25, 2025
```
Signed-off-by: Elnifio <elnifio0519@gmail.com>
```
  e1c7a4a4
24 Sep, 2025 1 commit

fix: update the tags for consistency and remove 0.4.1 refs (#3058) · 9e8f67ed

Harrison Saturley-Hall authored Sep 24, 2025


Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

9e8f67ed