Commits · 47d05d7a8168e269993963305f0aaaeac79e794e · OpenDAS / dynamo

16 Jun, 2025 2 commits
- build: DIS-148 use the tensorrt_llm public wheel from pypi by default in container build (#1525) · 47d05d7a
  richardhuo-nv authored Jun 16, 2025
  
  47d05d7a
- docs: update the multinode.md link to the correct path (#1535) · ce48a863
  runzhen authored Jun 15, 2025
```
Signed-off-by: Runzhen Wang <wangrunzhen@gmail.com>
```
  ce48a863
14 Jun, 2025 4 commits

feat: Standalone Router (#1409) · 13a99b7f

Yan Ru Pei authored Jun 14, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: jain-ria <riajain@NVIDIA.com>

13a99b7f

feat: add VllmDpWorker for DP setup (#1513) · 1906b702

GuanLuo authored Jun 13, 2025


Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>

1906b702

feat: SLA-based Planner (#1420) · 3f53a78e

Hongkuan Zhou authored Jun 13, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

3f53a78e

feat: add dynamo pipeline example using inf-gw (#1512) · 219cfa1f
Biswa Panda authored Jun 13, 2025

219cfa1f

13 Jun, 2025 14 commits
- feat: FT downed worker instance tracking and skipping (#1424) · a09ca3ec
  Jacky authored Jun 13, 2025
  
  a09ca3ec
- fix: enable GCP deployments (#1474) · 648740e8
  julienmancuso authored Jun 13, 2025
  
  648740e8
- fix: Improve dynamo.connect Error Reporting (#1524) · 281a69e5
  J Wyman authored Jun 13, 2025
  
  281a69e5
- chore: update dynamo and nixl versions for 0.3.1 (#1517) · 99e67e60
  Anant Sharma authored Jun 13, 2025
  
  99e67e60
- feat: add build --push command (#1485) · 50afb811
  hhzhang16 authored Jun 13, 2025
  
  50afb811
- docs: add trouble shooting section in benchmarking guide. Add known pitfall (#1503) · e621f249
  GuanLuo authored Jun 13, 2025
```
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  e621f249
- fix: Fix NATS_SERVER value, add details on customizing MOUNTS (#1520) · ae7e08a3
  Ryan McCormick authored Jun 14, 2025
  
  ae7e08a3
- feat: Video support with Dynamo (#1443) · 75503dae
  Indrajit Bhosale authored Jun 13, 2025
```
Added support in examples for multimodal video with aggregated and disaggregated architecture using LLaVA-NeXT-Video-7B
```
  75503dae
- docs: Cleanup & Standardize Guides (#1357) · 6f8c68c1
  J Wyman authored Jun 13, 2025
  
  6f8c68c1
- merging docs: fix DIS-133 and NvB 5322259 (#1518) to main · 1da05309
  Kristen Kelleher authored Jun 13, 2025
  
  1da05309
- docs: Add multi-node TRTLLM worker example (Deepseek R1) (#1511) · 40ca062f
  Ryan McCormick authored Jun 14, 2025
  
  40ca062f
- docs: Update main readme with Deepwiki and new documentation and examples links (#1510) · 382e3aed
  Harry Kim authored Jun 13, 2025
```
Signed-off-by: Harry Kim <harry_kim@live.com>
```
  382e3aed
- fix: remove LLMMetricAnnotation from response stream (#1499) · b051a213
  Hongkuan Zhou authored Jun 13, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  b051a213
- chore: add utilities for benchmarking (#1371) · fcfc21f2
  GuanLuo authored Jun 12, 2025
```
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  fcfc21f2
12 Jun, 2025 10 commits
- docs: fix the README link to the perf.sh file (#1501) · 0bba09a4
  richardhuo-nv authored Jun 12, 2025
  
  0bba09a4
- docs: add concurrency choice to the perf.sh (#1497) · 8585c300
  richardhuo-nv authored Jun 12, 2025
  
  8585c300
- docs: Fix Markdown Render Error (#1502) · 73e0f8ca
  J Wyman authored Jun 12, 2025
  
  73e0f8ca
- docs: DIS-133 and DIS-134 plus copyediting (#1439) · 0e7d4d82
  Kristen Kelleher authored Jun 12, 2025
```
Signed-off-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0e7d4d82
- test: add tests for kv_router::scheduler (#1491) · cb71be92
  Tianer Zhou authored Jun 13, 2025
```
Signed-off-by: Tianer Zhou <ezhoureal@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  cb71be92
- docs: Benchmarking guide interpreting results (#701) · fc5ddd2f
  Jacky authored Jun 12, 2025
```
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
```
  fc5ddd2f
- feat: add endpoint to clear all kv blocks in vllm v1 (#1384) · d0d364e3
  jain-ria authored Jun 11, 2025
  
  d0d364e3
- fix: dynamo-run change python subprocess from debug to info (#1484) · a4600ba1
  Alec authored Jun 11, 2025
  
  a4600ba1
- fix: Python respects DYN_LOG too (#1486) · af1f1155
  Alec authored Jun 11, 2025
  
  af1f1155
- chore: Move Benchmarking to Top Level (#1461) · 2ae9ab9f
  J Wyman authored Jun 11, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  2ae9ab9f
11 Jun, 2025 10 commits
- refactor: move kv store to runtime (#1459) · 08355da6
  Ryan Olson authored Jun 11, 2025
  
  08355da6
- feat: generalize VLM embedding extraction (#1388) · e924a7c7
  hhzhang16 authored Jun 11, 2025
```
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
```
  e924a7c7
- build: enable vllm runtime container as default container for ci pipelines (#1451) · c43ebd24
  Tushar Sharma authored Jun 11, 2025
  
  c43ebd24
- chore: update attributions files post 0.3.0 release (#1438) · a298ce9c
  Anant Sharma authored Jun 11, 2025
  
  a298ce9c
- docs: Add note about ignore_eos for MTP (#1475) · 150e983a
  Ryan McCormick authored Jun 12, 2025
  
  150e983a
- refactor: use comment filed in annotated to pass metric-related information (#1385) · 227a0e71
  Hongkuan Zhou authored Jun 11, 2025
  
  227a0e71
- docs: MTP + TensorRT LLM + DS R1 disaggregated example (#1473) · 3363d8b6
  richardhuo-nv authored Jun 11, 2025
  
  3363d8b6
- docs: add message to guide users to the stable version (#1457) · e32fe675
  richardhuo-nv authored Jun 11, 2025
  
  e32fe675
- ci: Add time delays for server start up. (#1452) · adeaa903
  Pavithra Vijayakrishnan authored Jun 11, 2025
```
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
```
  adeaa903
- feat: generate random texts from hashes using lorem ipsum (#1458) · 1f59718f
  Yan Ru Pei authored Jun 10, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  1f59718f