Commits · 64445c0a06910cf6ddba98418a3c34115cec0e9e · OpenDAS / dynamo

"vllm/benchmarks/benchmark_utils.py" did not exist on "e7ef74e26e4dcd7626db82e40baee2b7991c35ac"

17 Jun, 2025 7 commits
- feat(sglang): deepep sglang support in dynamo (#1120) · 64445c0a
  ishandhanani authored Jun 17, 2025
```
Co-authored-by: kkranen <kyle.kranen@gmail.com>
```
  64445c0a
- fix: Handle model not found error for multimodal example (#1545) · e2716073
  Kris Hung authored Jun 17, 2025
  
  e2716073
- docs: fix typo 'dependancy' to 'dependency' (#1552) · 636bac0e
  Shriyash.Patil authored Jun 17, 2025
```
Signed-off-by: Shriyash.Patil <shriyash81@gmail.com>
```
  636bac0e
- docs: add docs and example for inference gateway deployment (#1533) · 2a28c421
  Biswa Panda authored Jun 16, 2025
  
  2a28c421
- feat: add vllm_v1 framework to run command (#1550) · 9f81df28
  Biswa Panda authored Jun 16, 2025
  
  9f81df28
- fix: update nixl build and keep wheels dir in vllm container (#1544) · 7609c0dc
  Anant Sharma authored Jun 16, 2025
  
  7609c0dc
- fix: handle error in port reserve and cleanup allocator (#1536) · 5465f9ea
  Biswa Panda authored Jun 16, 2025
  
  5465f9ea
16 Jun, 2025 4 commits
- fix: remove lib.real from LD_LIBRARY_PATH (#1546) · a67e682b
  Tanmay Verma authored Jun 16, 2025
  
  a67e682b
- chore: disable auto incremental coderabbit review (#1472) · 6063b1b9
  Anant Sharma authored Jun 16, 2025
  
  6063b1b9
- build: DIS-148 use the tensorrt_llm public wheel from pypi by default in container build (#1525) · 47d05d7a
  richardhuo-nv authored Jun 16, 2025
  
  47d05d7a
- docs: update the multinode.md link to the correct path (#1535) · ce48a863
  runzhen authored Jun 15, 2025
```
Signed-off-by: Runzhen Wang <wangrunzhen@gmail.com>
```
  ce48a863
14 Jun, 2025 4 commits

feat: Standalone Router (#1409) · 13a99b7f

Yan Ru Pei authored Jun 14, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: jain-ria <riajain@NVIDIA.com>

13a99b7f

feat: add VllmDpWorker for DP setup (#1513) · 1906b702

GuanLuo authored Jun 13, 2025


Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>

1906b702

feat: SLA-based Planner (#1420) · 3f53a78e

Hongkuan Zhou authored Jun 13, 2025

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

3f53a78e

feat: add dynamo pipeline example using inf-gw (#1512) · 219cfa1f
Biswa Panda authored Jun 13, 2025

219cfa1f

13 Jun, 2025 14 commits
- feat: FT downed worker instance tracking and skipping (#1424) · a09ca3ec
  Jacky authored Jun 13, 2025
  
  a09ca3ec
- fix: enable GCP deployments (#1474) · 648740e8
  julienmancuso authored Jun 13, 2025
  
  648740e8
- fix: Improve dynamo.connect Error Reporting (#1524) · 281a69e5
  J Wyman authored Jun 13, 2025
  
  281a69e5
- chore: update dynamo and nixl versions for 0.3.1 (#1517) · 99e67e60
  Anant Sharma authored Jun 13, 2025
  
  99e67e60
- feat: add build --push command (#1485) · 50afb811
  hhzhang16 authored Jun 13, 2025
  
  50afb811
- docs: add trouble shooting section in benchmarking guide. Add known pitfall (#1503) · e621f249
  GuanLuo authored Jun 13, 2025
```
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  e621f249
- fix: Fix NATS_SERVER value, add details on customizing MOUNTS (#1520) · ae7e08a3
  Ryan McCormick authored Jun 14, 2025
  
  ae7e08a3
- feat: Video support with Dynamo (#1443) · 75503dae
  Indrajit Bhosale authored Jun 13, 2025
```
Added support in examples for multimodal video with aggregated and disaggregated architecture using LLaVA-NeXT-Video-7B
```
  75503dae
- docs: Cleanup & Standardize Guides (#1357) · 6f8c68c1
  J Wyman authored Jun 13, 2025
  
  6f8c68c1
- merging docs: fix DIS-133 and NvB 5322259 (#1518) to main · 1da05309
  Kristen Kelleher authored Jun 13, 2025
  
  1da05309
- docs: Add multi-node TRTLLM worker example (Deepseek R1) (#1511) · 40ca062f
  Ryan McCormick authored Jun 14, 2025
  
  40ca062f
- docs: Update main readme with Deepwiki and new documentation and examples links (#1510) · 382e3aed
  Harry Kim authored Jun 13, 2025
```
Signed-off-by: Harry Kim <harry_kim@live.com>
```
  382e3aed
- fix: remove LLMMetricAnnotation from response stream (#1499) · b051a213
  Hongkuan Zhou authored Jun 13, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  b051a213
- chore: add utilities for benchmarking (#1371) · fcfc21f2
  GuanLuo authored Jun 12, 2025
```
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  fcfc21f2
12 Jun, 2025 10 commits
- docs: fix the README link to the perf.sh file (#1501) · 0bba09a4
  richardhuo-nv authored Jun 12, 2025
  
  0bba09a4
- docs: add concurrency choice to the perf.sh (#1497) · 8585c300
  richardhuo-nv authored Jun 12, 2025
  
  8585c300
- docs: Fix Markdown Render Error (#1502) · 73e0f8ca
  J Wyman authored Jun 12, 2025
  
  73e0f8ca
- docs: DIS-133 and DIS-134 plus copyediting (#1439) · 0e7d4d82
  Kristen Kelleher authored Jun 12, 2025
```
Signed-off-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  0e7d4d82
- test: add tests for kv_router::scheduler (#1491) · cb71be92
  Tianer Zhou authored Jun 13, 2025
```
Signed-off-by: Tianer Zhou <ezhoureal@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  cb71be92
- docs: Benchmarking guide interpreting results (#701) · fc5ddd2f
  Jacky authored Jun 12, 2025
```
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
```
  fc5ddd2f
- feat: add endpoint to clear all kv blocks in vllm v1 (#1384) · d0d364e3
  jain-ria authored Jun 11, 2025
  
  d0d364e3
- fix: dynamo-run change python subprocess from debug to info (#1484) · a4600ba1
  Alec authored Jun 11, 2025
  
  a4600ba1
- fix: Python respects DYN_LOG too (#1486) · af1f1155
  Alec authored Jun 11, 2025
  
  af1f1155
- chore: Move Benchmarking to Top Level (#1461) · 2ae9ab9f
  J Wyman authored Jun 11, 2025
```
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  2ae9ab9f
11 Jun, 2025 1 commit
- refactor: move kv store to runtime (#1459) · 08355da6
  Ryan Olson authored Jun 11, 2025
  
  08355da6