Commits · 5744548bdfd7ffe4ec3de15b3fc3b04b038ffda3 · OpenDAS / dynamo

"vllm/vscode:/vscode.git/clone" did not exist on "2cc26c3a9973257d5fcc582f063915d52dded86f"

11 Oct, 2025 1 commit

feat: add SGLang and vLLM passthrough metrics on Dynamo backend worker (#3539) · 55e458d8

Keiven C authored Oct 10, 2025


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

55e458d8

10 Oct, 2025 1 commit

docs: move all md files from components to docs (#3440) · 0a2a820b

Anant Sharma authored Oct 09, 2025


Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

0a2a820b

09 Oct, 2025 4 commits
- refactor: remove sglang config and util files from components (#3467) · 03bdced9
  Anant Sharma authored Oct 09, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  03bdced9
- feat: sglang prefill router + bump to `0.5.3` (#3498) · 51f65757
  ishandhanani authored Oct 09, 2025
  
  51f65757
- chore: Remove clear_namespace script (#3519) · e9a71009
  Graham King authored Oct 09, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  e9a71009
- fix: fix config updates on deep copy not propagating back (#3512) · bd28e442
  Hongkuan Zhou authored Oct 08, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  bd28e442
08 Oct, 2025 1 commit
- fix: update dynamo namespace env var usage (#3477) · 552146f2
  Biswa Panda authored Oct 08, 2025
  
  552146f2
07 Oct, 2025 3 commits
- feat: pre-deployment profiling automatically generates and deploys optimized... · 83e259a7
  Hongkuan Zhou authored Oct 07, 2025
```
feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  83e259a7
- chore: Clean up for sglang multimodal example (#3420) · ddbb4f50
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  ddbb4f50
- feat: Add embedding support to sgl backend (#3427) · d809906e
  Kris Hung authored Oct 06, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  d809906e
06 Oct, 2025 1 commit
- refactor: clean up sglang apis [1/n] (#3432) · de5c39df
  ishandhanani authored Oct 06, 2025
  
  de5c39df
02 Oct, 2025 2 commits
- fix: correctly parse subcomponent in sla-planner + deploy/doc update (#3363) · cfe74445
  Hongkuan Zhou authored Oct 02, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cfe74445
- feat: Add multimodal EPD for Sglang (#3230) · 62661cce
  Kris Hung authored Oct 01, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  62661cce
01 Oct, 2025 2 commits
- feat: restructure source code for python packaging (#3201) · 836d7417
  Anant Sharma authored Oct 01, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
```
  836d7417
- feat: Add vLLM compilation cache to Dynamo Operator (#3257) · fcc42624
  Michael Shin authored Oct 01, 2025
```
Signed-off-by: Michael Shin <michaelshin@users.noreply.github.com>
```
  fcc42624
30 Sep, 2025 2 commits
- feat: Add --custom-jinja-template argument to pass a custom chat template for SGLang (#3165) · f95ba894
  KrishnanPrash authored Sep 30, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f95ba894
- chore: update slurm scrips for better warmup and bump sgl version (#3291) · 0ab6bc2b
  ishandhanani authored Sep 30, 2025
  
  0ab6bc2b
29 Sep, 2025 2 commits
- feat: use python3 in all examples (#3259) · a01b7992
  Julien Mancuso authored Sep 29, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  a01b7992
- feat: add subComponentType in DGD API and uptake in planner (#3200) · 1a5016b0
  Thomas Montfort authored Sep 29, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
```
  1a5016b0
26 Sep, 2025 1 commit
- docs: Add gpt-oss guide with reasoning / tool calling for vLLM and SGLang (#3219) · e2444577
  GuanLuo authored Sep 26, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  e2444577
25 Sep, 2025 1 commit
- feat: update how we wait for model before model is ready (#3050) · e1c7a4a4
  Yunzhou Liu authored Sep 25, 2025
```
Signed-off-by: Elnifio <elnifio0519@gmail.com>
```
  e1c7a4a4
24 Sep, 2025 5 commits
- fix: update the tags for consistency and remove 0.4.1 refs (#3058) · 9e8f67ed
  Harrison Saturley-Hall authored Sep 24, 2025
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
```
  9e8f67ed
- feat: add NIM FE (num_request_max) + runtime config metrics with periodic polling (#3107) · 116b9b43
  Keiven C authored Sep 24, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  116b9b43
- feat: update planner manifests for Grove support (#3203) · 8bc2191e
  Thomas Montfort authored Sep 24, 2025
  
  8bc2191e
- feat: allow framework tokenization/detokenization (#3134) · f9be2e9e
  ishandhanani authored Sep 24, 2025
```
Co-authored-by: Ubuntu <ubuntu@ip-172-31-44-124.ec2.internal>
```
  f9be2e9e
- feat: support MoE model in SLA Planner Sglang (#3185) · 6243bcbe
  Hongkuan Zhou authored Sep 23, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  6243bcbe
23 Sep, 2025 2 commits

feat: revamp kubernetes doc (#3173) · 4a718028

Julien Mancuso authored Sep 23, 2025


Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

4a718028

feat: use bos_token_id for sglang's health check payload (#3123) · c4334471
Tzu-Ling Kan authored Sep 22, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
c4334471

19 Sep, 2025 2 commits
- fix: small planner manifest/doc fixes (#3129) · 7d2fc13e
  Thomas Montfort authored Sep 19, 2025
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
```
  7d2fc13e
- feat: Sglang canary health check (#3103) · 56f423c6
  Tzu-Ling Kan authored Sep 19, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  56f423c6
18 Sep, 2025 2 commits

feat: Update docs to indicate need to use consistent hashing for KV events in... · 3b6dbef2

Chi McIsaac authored Sep 18, 2025

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

3b6dbef2

chore(bindings): Provide a binding to clear etcd namespace (#3094) · b6595e24
Graham King authored Sep 18, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
b6595e24

17 Sep, 2025 1 commit
- fix: resolve token loss bug in final packet (#2985) · 045b61dd
  Xuwei authored Sep 17, 2025
```
Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>
```
  045b61dd
16 Sep, 2025 1 commit
- fix: replace hard coded dynamo namespace with env var (#3048) · 960dc896
  Biswa Panda authored Sep 16, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  960dc896
10 Sep, 2025 1 commit

feat: sglang multiple frontend slurm deployment scripts (#2623) · 4b3a2c1a

ishandhanani authored Sep 10, 2025


Signed-off-by: ishandhanani <ishandhanani@gmail.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>

4b3a2c1a

09 Sep, 2025 3 commits
- docs: fix broken links (#2965) · 3ea3d59b
  nv-nmailhot authored Sep 09, 2025
  
  3ea3d59b
- fix: no reasoning parser by default (#2939) · 939ede86
  Neal Vaidya authored Sep 09, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  939ede86
- feat: update benchmarking and deploy utils (#2933) · 09c7b73c
  hhzhang16 authored Sep 08, 2025
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  09c7b73c
08 Sep, 2025 2 commits
- chore: add preference logic for using tool-call and reasoning parsers for sglang (#2922) · 4a73b3c6
  Ayush Agarwal authored Sep 08, 2025
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  4a73b3c6
- fix: fix typo in multinode example (#2931) · 6441ed36
  julienmancuso authored Sep 08, 2025
```
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
```
  6441ed36