Commits · fde25fef0cbe3dbe51cb41a9302d7894dd58f061 · OpenDAS / dynamo

"...bindings/python/rust/dyn:/nemotron_super.backend.generate" did not exist on "dcad8ac76c9fac384cac520c6867616c8f0bce98"

10 Jul, 2025 9 commits
- docs: add docs for profile_sla npz file format (#1859) · fde25fef
  Hongkuan Zhou authored Jul 10, 2025
  
  fde25fef
- fix: prevent null second token output & reduce time to second token l… (#1861) · 382fa2c2
  Ethan-ES authored Jul 11, 2025
```
Co-authored-by: root <root@H20-GPU-24.cm.cluster>
```
  382fa2c2
- fix: KeyError in kv_router.py by Initializing active_blocks_dict for New Workers (#1827) · 83345419
  Umang Kedia authored Jul 10, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  83345419
- fix: add Grafana JSON files back that were accidentally deleted (#1843) · 7ba05754
  Keiven C authored Jul 10, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  7ba05754
- perf(runtime): Use all available parallelism (#1858) · da83f820
  Graham King authored Jul 10, 2025
  
  da83f820
- feat: add multimodal k8s deployment manifest (#1836) · e1ae0f15
  Biswa Panda authored Jul 10, 2025
  
  e1ae0f15
- fix: metrics publishing in vllm v0 worker (#1845) · 39c8d125
  jain-ria authored Jul 09, 2025
  
  39c8d125
- fix: update v1 docs (#1849) · 0f2fa928
  Alec authored Jul 09, 2025
  
  0f2fa928
- feat: update active blocks in chunks only when necessary (#1848) · 5e511e92
  Yan Ru Pei authored Jul 09, 2025
  
  5e511e92
09 Jul, 2025 8 commits
- feat: remove minio dependency (#1833) · 7bc70bc9
  julienmancuso authored Jul 09, 2025
  
  7bc70bc9
- fix: use port 9401 inside and outside of container (#1838) · b0ceb4d3
  Keiven C authored Jul 09, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  b0ceb4d3
- chore: add info about cache flush and bump version (#1839) · 7dea77c3
  ishandhanani authored Jul 09, 2025
  
  7dea77c3
- feat: remove DYN_DEPLOYMENT_CONFIG in examples (#1820) · a604c7f0
  julienmancuso authored Jul 09, 2025
  
  a604c7f0
- chore(cli.py): dynamo-run-in-python handle sglang, vllm and trtllm (#1832) · 93acc631
  Graham King authored Jul 09, 2025
  
  93acc631
- docs: clarify metrics visualization instructions. Removed unused file. (#1824) · e756f390
  Keiven C authored Jul 09, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  e756f390
- feat: Support for unary tool use in ChatCompletions API (#1800) · 5e2f29f5
  Paul Hendricks authored Jul 09, 2025
  
  5e2f29f5
- fix: updating test to not set port (#1823) · 6835dd7a
  Neelay Shah authored Jul 08, 2025
  
  6835dd7a
08 Jul, 2025 17 commits
- feat: Build DistributedRuntime-level HTTP server with /health /metrics (#1656) · ece76a62
  ZichengMa authored Jul 08, 2025
  
  ece76a62
- fix: update trtllm runtime build (#1810) · 789c8284
  Anant Sharma authored Jul 08, 2025
  
  789c8284
- feat(python): Python bindings for the Dynamo CLI tools (#1799) · 2bf27924
  Graham King authored Jul 08, 2025
  
  2bf27924
- chore(CODEOWNERS): Use Team alias for Rust code owners (#1817) · 3e3ff934
  Graham King authored Jul 08, 2025
  
  3e3ff934
- chore: add `net-tools` to dockerfile for `ifconfig` usage in deployment (#1818) · eec49661
  ishandhanani authored Jul 08, 2025
  
  eec49661
- fix: Update docker-compose.yml path for examples/llm/benchmarks (#1816) · c5f5dd2d
  Jacky authored Jul 08, 2025
  
  c5f5dd2d
- chore: multinode dsr1 doc fix (#1814) · 330e649c
  ishandhanani authored Jul 08, 2025
  
  330e649c
- feat: undo coderabbit requested changes (#1813) · 427d5471
  hhzhang16 authored Jul 08, 2025
  
  427d5471
- fix: fix gpu resource spec in llm deployments (#1812) · c183aa31
  Biswa Panda authored Jul 08, 2025
  
  c183aa31
- chore(CODEOWNERS): Make `*.rs` and `Cargo.toml` lists the same (#1811) · 24bede9b
  Graham King authored Jul 08, 2025
  
  24bede9b
- feat: add runtime image for trtllm container build (#1796) · 909a9a9f
  Anant Sharma authored Jul 08, 2025
  
  909a9a9f
- feat: remove dynamo deployment from cli (#1742) · fbd1f8df
  Biswa Panda authored Jul 08, 2025
  
  fbd1f8df
- feat: predictive active blocks for routing without load metrics (#1731) · 84e71e27
  Yan Ru Pei authored Jul 08, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  84e71e27
- ci: add sglang gpu based CI tests (#1744) · ffccc722
  ishandhanani authored Jul 07, 2025
  
  ffccc722
- feat: add a new composite SW/HW grafana (DYN-678) (#1788) · ebd23361
  Keiven C authored Jul 07, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  ebd23361
- docs: add Dynamo architecture flow documentation and diagram (#1697) · 0584b081
  Arun Raman authored Jul 07, 2025
```
Signed-off-by: Arun Raman <arunraman@users.noreply.github.com>
Co-authored-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: Neal Vaidya <neal098@gmail.com>
```
  0584b081
- feat: simplify k8s deployment (#1708) · 7a341f86
  julienmancuso authored Jul 07, 2025
  
  7a341f86
07 Jul, 2025 6 commits
- feat: add crds for vllm and llm examples (#1766) · 5505507b
  mohammedabdulwahhab authored Jul 07, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  5505507b
- feat: vllm speculative decoding metrics (#1549) · 439e977d
  jain-ria authored Jul 07, 2025
```
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
```
  439e977d
- fix: for handling zombie process (#1801) · a9c0e0c7
  Neelay Shah authored Jul 07, 2025
  
  a9c0e0c7
- fix: include load and sla planner doc (#1803) · c9a60278
  Hongkuan Zhou authored Jul 07, 2025
  
  c9a60278
- docs: Remove the outdated limitation (#1802) · b1509ea7
  Tanmay Verma authored Jul 07, 2025
  
  b1509ea7
- chore: update versions for 0.3.2 release (#1793) · c4935b34
  Anant Sharma authored Jul 07, 2025
  
  c4935b34