Commits · d51580a418c9a7f72360209b3d65a7f6b794a618 · OpenDAS / dynamo

"docs/architecture/planner.md" did not exist on "8d636ebdbeafe82b76264a0e9ca7f6a9c9015c96"

11 Aug, 2025 6 commits
- docs: add sglang installation variants (#2400) · d51580a4
  ishandhanani authored Aug 11, 2025
  
  d51580a4
- fix: Fixes OPS-618 Add Access Token for accessing containers on NGC (#2395) · 4d24d03b
  Tushar Sharma authored Aug 11, 2025
  
  4d24d03b
- fix(preprocessor): Populate model ID in PreprocessedRequest (#2397) · c443528f
  Graham King authored Aug 11, 2025
  
  c443528f
- feat: cuda traits and interoperability with external contexts (#2340) · b5efb957
  Ryan Olson authored Aug 11, 2025
  
  b5efb957
- fix: use default batch_size for decode (#2376) · 43854732
  Neal Vaidya authored Aug 10, 2025
  
  43854732
- docs: add sglang hicache example and guide (#2388) · 3b722842
  Faradawn Yang authored Aug 10, 2025
  
  3b722842
08 Aug, 2025 4 commits
- docs: Update nixl_connect README (#2320) · fa4a7f1e
  J Wyman authored Aug 08, 2025
  
  fa4a7f1e
- docs: exporting metrics in k8s (dep-302) (#2271) · 5375af2c
  mohammedabdulwahhab authored Aug 08, 2025
  
  5375af2c
- fix: Copy cuda libraries from devel to runtime stage (#2301) · 77b53c41
  Tushar Sharma authored Aug 08, 2025
  
  77b53c41
- fix: use wheel files for installation in trtllm build (#2372) · 90ef3038
  Anant Sharma authored Aug 08, 2025
  
  90ef3038
07 Aug, 2025 12 commits
- docs: fix lowest cost mistake in doc (#2361) · f7e468c7
  Yan Ru Pei authored Aug 07, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  f7e468c7
- feat: Router replicas with state-sharing (#2264) · 5166a3dd
  Yan Ru Pei authored Aug 07, 2025
  
  5166a3dd
- build: introduce dynamo base container (#2222) · 10f4302d
  Tushar Sharma authored Aug 07, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  10f4302d
- chore: guided decoding support for nvext (#2339) · b165ec4a
  Ayush Agarwal authored Aug 07, 2025
```
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  b165ec4a
- chore(metrics): Remove the Arc (#2357) · a3f7a39f
  Graham King authored Aug 07, 2025
  
  a3f7a39f
- feat: cross process instrumentation (#2243) · bd4fe1a7
  Neelay Shah authored Aug 07, 2025
```
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>
```
  bd4fe1a7
- chore: Remove service_name from ModelDeploymentCard (#2349) · 1954fcfa
  Graham King authored Aug 07, 2025
  
  1954fcfa
- fix: improve HF token handling in preprocessor tests (#2321) · ccc8815b
  Keiven C authored Aug 06, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  ccc8815b
- refactor: Rename HTTP server to metrics server in worker process (#2318) · 254f4819
  Yingge He authored Aug 06, 2025
  
  254f4819
- feat: DIS-323 [trtllm backend publisher] only publish kv event with the... · 2cf67765
  Richard Huo authored Aug 06, 2025
```
feat: DIS-323 [trtllm backend publisher] only publish kv event with the biggest window size to support kv routing with variable sliding window attention (#2241)
```
  2cf67765
- fix: Reduce disk space usage in pre-merge-rust action (removes unnecessary... · 5fad47f7
  Ryan McCormick authored Aug 06, 2025
```
fix: Reduce disk space usage in pre-merge-rust action (removes unnecessary sccache artifacts) (#2337)
```
  5fad47f7
- feat: LMCache integration in newest ux (#2079) · 784da90e
  ZichengMa authored Aug 06, 2025
```
Signed-off-by: ZichengMa <zichengma1225@gmail.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
```
  784da90e
06 Aug, 2025 10 commits
- fix: Restore running single-process without etcd (#2342) · 63fbf498
  Graham King authored Aug 06, 2025
  
  63fbf498
- chore: Bump mistral.rs, llama.cpp and tokenizers deps (#2338) · dbe48a1d
  Graham King authored Aug 06, 2025
  
  dbe48a1d
- fix: upgrade axum to 0.8 and etcd-client to 0.16 (#2317) · b2aa504b
  Dan Aloni authored Aug 06, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
```
  b2aa504b
- docs(dynamo-run): Remove vllm/sglang/trtllm engines from dynamo-run docs (#2332) · 6be5c196
  Graham King authored Aug 06, 2025
  
  6be5c196
- fix: nil pointer deref in dynamo controller (#2333) · c264018a
  mohammedabdulwahhab authored Aug 06, 2025
  
  c264018a
- feat: Support static workers, run without etcd. (#2281) · 6a1a801c
  Graham King authored Aug 06, 2025
  
  6a1a801c
- feat: recorder graceful drop (#2327) · 0802ecd9
  Yan Ru Pei authored Aug 05, 2025
  
  0802ecd9
- fix: Move register_llm_block down (#2316) · 8291172f
  Chi authored Aug 05, 2025
  
  8291172f
- feat: Multimodal support for dynamo with trtllm backend (#2195) · 12fe3551
  Indrajit Bhosale authored Aug 05, 2025
  
  12fe3551
- fix: Revert the commit for DeepGEMM to fix vLLM WideEP (#2302) · ef2b0e67
  Kris Hung authored Aug 05, 2025
  
  ef2b0e67
05 Aug, 2025 8 commits
- test: e2e test of two Router replicas with mockers (#2324) · f962c7d6
  Yan Ru Pei authored Aug 05, 2025
  
  f962c7d6
- fix: triton ver lock fix and trtllm env var declaration (#2300) · 9630693e
  Dmitry Tokarev authored Aug 05, 2025
  
  9630693e
- docs: use prebuilt gpt-oss container (#2313) · 3a425209
  Neal Vaidya authored Aug 05, 2025
  
  3a425209
- docs: fix issues in gpt-oss guide (#2304) · bc3456b4
  Neal Vaidya authored Aug 05, 2025
  
  bc3456b4
- fix: doc links (#2309) · 20d284e8
  Biswa Panda authored Aug 05, 2025
  
  20d284e8
- ci: Improve caching on pre-merge-rust (#2253) · e95f8758
  Ryan McCormick authored Aug 05, 2025
  
  e95f8758
- feat: migrate requests when planner shutdown decode engine (vllm) (#2280) · 36c4ef5e
  Hongkuan Zhou authored Aug 05, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  36c4ef5e
- docs: add TRTLLM variable sliding window attention example for gemma3 model (#2134) · c8f6d4d9
  Richard Huo authored Aug 05, 2025
  
  c8f6d4d9