Commits · f3d784f3f20493691331e57763793f39d81d842d · OpenDAS / dynamo · GitLab

"vscode:/vscode.git/clone" did not exist on "6d69e8c7b086f14e9cb46afac57db5f7616d8b93"

23 Jul, 2025 14 commits
- feat: query instance_id based on routing strategy (#1787) · f3d784f3
  Biswa Panda authored Jul 23, 2025
  
  f3d784f3
- feat: sglang examples launch and deploy (#2068) · 13560ab2
  Biswa Panda authored Jul 23, 2025
  
  13560ab2
- chore: update attributions for 0.3.2 release (#1837) (#2032) · 7a0013be
  Anant Sharma authored Jul 23, 2025
  
  7a0013be
- fix: github ci triggers (#2075) · 9bdceac0
  Biswa Panda authored Jul 23, 2025
  
  9bdceac0
- fix: updates versions and adds ahashmap to BPE (#2072) · 66b7d2c7
  Paul Hendricks authored Jul 23, 2025
  
  66b7d2c7
- fix: Bring back ignore_eos/min_tokens support in trtllm component (#2023) · f9b1757f
  Ryan McCormick authored Jul 23, 2025
```
Signed-off-by: Ryan McCormick <mccormick.codes@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
```
  f9b1757f
- docs: Adjust the path to examples (#2056) · eebc7410
  atchernych authored Jul 23, 2025
  
  eebc7410
- fix: endpoint changes should be prioritized over new requests in kv scheduler (#2071) · ffb54096
  Yan Ru Pei authored Jul 23, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  ffb54096
- feat: Connect Library (#1478) · e0a51940
  J Wyman authored Jul 23, 2025
  
  e0a51940
- ci: Add RUN_SGLANG to CI variables (#1928) · c6f12f64
  Pavithra Vijayakrishnan authored Jul 23, 2025
```
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
```
  c6f12f64
- fix: cryptic error message for empty messages list in /chat/completions #2067 (#2067) · 6a69ef4f
  heisenberglit authored Jul 23, 2025
  
  6a69ef4f
- fix: vllm deployment examples (#2062) · 2c642fd0
  Biswa Panda authored Jul 22, 2025
  
  2c642fd0
- build: Fixes for vLLM Blackwell Builds (#2020) · 1958b3aa
  zaristei authored Jul 22, 2025
  
  1958b3aa
- feat: health check changes based on endpoint served (#1996) · b127d95f
  Neelay Shah authored Jul 22, 2025
  
  b127d95f
22 Jul, 2025 12 commits
- chore: Change vllm K8s from dynamo-run to python -m dynamo.frontend (#2055) · 22e6c96f
  Graham King authored Jul 22, 2025
  
  22e6c96f
- chore: Bump genai-perf to v0.0.15 (#2051) · 9cfaa7be
  ptarasiewiczNV authored Jul 22, 2025
  
  9cfaa7be
- refactor: vLLM to new Python UX (#1983) · f3e3d94a
  Alec authored Jul 22, 2025
```
Co-authored-by: Graham King <grahamk@nvidia.com>
```
  f3e3d94a
- chore: Remove unused portion of kv bindings test (#2052) · 9f2356cb
  Ryan McCormick authored Jul 22, 2025
  
  9f2356cb
- docs: Cleanup index.rst (#2007) · c49a13eb
  atchernych authored Jul 22, 2025
  
  c49a13eb
- fix: correct Nixl plugin paths in Dockerfile. (#2048) · 73505c77
  Kapil Arya authored Jul 22, 2025
  
  73505c77
- chore(sglang): Move examples/sglang to components/backends/sglang (#2046) · d65ce1b0
  Graham King authored Jul 22, 2025
  
  d65ce1b0
- feat: use atomic transactions when creating etcd kv (#2044) · 78826932
  Yan Ru Pei authored Jul 22, 2025
  
  78826932
- feat: add a hierarchical Prometheus MetricsRegistry trait for... · e5a8628f
  Keiven C authored Jul 22, 2025
```
feat: add a hierarchical Prometheus MetricsRegistry trait for DistributedRuntime, Namespace, Components, and Endpoint (#2008)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Ryan Olson <rolson@nvidia.com>
```
  e5a8628f
- fix: install torch distribution matching container cuda version (#2027) · 20c5daf3
  ptarasiewiczNV authored Jul 22, 2025
  
  20c5daf3
- fix: never sleep on the eos (#2039) · 4449f3da
  Alec authored Jul 21, 2025
  
  4449f3da
- refactor: support for turning prefix cache off (#2034) · 76fd4716
  Alec authored Jul 21, 2025
  
  76fd4716
21 Jul, 2025 4 commits
- docs: fix helm chart urls (#2033) · ac7e8882
  Neal Vaidya authored Jul 21, 2025
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
```
  ac7e8882
- fix: mypy error (#2029) · d4b5414a
  atchernych authored Jul 21, 2025
  
  d4b5414a
- build: support custom TRTLLM build for commits not on main branch (#2021) · 79337c7d
  Ryan McCormick authored Jul 21, 2025
  
  79337c7d
- docs: Post-Merge cleanup of the deploy documentation (#1922) · 95dd9426
  atchernych authored Jul 21, 2025
  
  95dd9426
20 Jul, 2025 1 commit

chore: Install vLLM and WideEP kernels in vLLM runtime container (#2010) · cb6de94d

ptarasiewiczNV authored Jul 20, 2025

Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>

cb6de94d

19 Jul, 2025 2 commits
- fix: Revert "feat: add vLLM v1 multi-modal example. Add llama4 Maverick ex… (#2017) · fe63c17a
  Alec authored Jul 18, 2025
  
  fe63c17a
- fix: Don't detokenize twice in TRT-LLM examples (#1955) · bf1998f0
  jthomson04 authored Jul 18, 2025
  
  bf1998f0
18 Jul, 2025 7 commits
- feat: http disconnects (#2014) · 343a4814
  Ryan Olson authored Jul 18, 2025
  
  343a4814
- feat: enable / disable chunked prefill for mockers (#2015) · e330d969
  Yan Ru Pei authored Jul 18, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  e330d969
- feat: add vLLM v1 multi-modal example. Add llama4 Maverick example (#1990) · 353146e2
  GuanLuo authored Jul 18, 2025
```
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: krishung5 <krish@nvidia.com>
```
  353146e2
- feat: Add migration to LLM requests (#1930) · 1f07dab7
  Jacky authored Jul 18, 2025
  
  1f07dab7
- refactor: Migrate to new UX2 for python launch (#2003) · 5f179186
  Tanmay Verma authored Jul 18, 2025
  
  5f179186
- feat(frontend): router-mode settings (#2001) · fc124360
  Graham King authored Jul 18, 2025
  
  fc124360
- chore: Move NIXL repo clone to Dockerfiles (#2009) · dc75cf18
  ptarasiewiczNV authored Jul 18, 2025
  
  dc75cf18