Commits · f476fd74c4048075a01b7ccf96a3512a0b25dbee · OpenDAS / dynamo · GitLab

14 Aug, 2025 4 commits
- feat: logprob handling (#2426) · f476fd74
  Greg Clark authored Aug 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  f476fd74
- chore: Upgrade volcano dependency version (#2442) · 5816c082
  Jesse Stutler authored Aug 14, 2025
```
Signed-off-by: jessestutler <jesseincomparable@hotmail.com>
```
  5816c082
- fix: Update gpt-oss.md w/ HF CLI pip install (#2431) · 20ad730c
  Anish authored Aug 13, 2025
```
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  20ad730c
- feat: add dynamo environment checker script (#2419) · da1bf521
  Keiven C authored Aug 13, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  da1bf521
13 Aug, 2025 12 commits
- fix(ci): Reduce the free gpu memory fraction (#2433) · f6fef485
  Tanmay Verma authored Aug 13, 2025
  
  f6fef485
- feat: Add vars to multi-node trtllm slurm scripts to support xP yD deployments (#2429) · cebe9219
  Ryan McCormick authored Aug 13, 2025
  
  cebe9219
- fix: Fix ETCD and NATS starvation under massive request concurrency (#2384) · dcfa87be
  jthomson04 authored Aug 13, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  dcfa87be
- feat: enable custom metrics prefix (#2432) · 3411bda8
  ryan-lempka authored Aug 13, 2025
  
  3411bda8
- chore: Refactor tool calling for wider support in the future (#2393) · 086ea4f0
  Elyas Mehtabuddin authored Aug 13, 2025
  
  086ea4f0
- fix: upgrade cudarc to 0.17.1 (#2341) · c12c2578
  Dan Aloni authored Aug 13, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  c12c2578
- fix: Add detokenize stream (#2413) · 8c40bbb0
  jthomson04 authored Aug 13, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  8c40bbb0
- test: add kv routing test for sglang (#2424) · c0ed76da
  ishandhanani authored Aug 13, 2025
```
Signed-off-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  c0ed76da
- feat: LLM metrics for non-streaming requests in frontend (#2427) · c3ecaf6c
  Hongkuan Zhou authored Aug 13, 2025
  
  c3ecaf6c
- feat: Allow an endpoint to serve multiple models (#2418) · 72ec5f5c
  Graham King authored Aug 13, 2025
  
  72ec5f5c
- chore: update wideep dockerfile for sgl to newest rel (#2422) · ebc84d6c
  ishandhanani authored Aug 12, 2025
  
  ebc84d6c
- feat: support sglang in sla planner (#2421) · e22f84ab
  Hongkuan Zhou authored Aug 12, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  e22f84ab
12 Aug, 2025 7 commits
- feat: multi-modal example with vLLM v1 and UX v2 (#2040) · 9b87c89c
  GuanLuo authored Aug 12, 2025
```
Co-authored-by: krishung5 <krish@nvidia.com>
```
  9b87c89c
- feat: Add performance sweeps for DeepSeek R1 on GB200 (#2387) · 1327e3bb
  Tanmay Verma authored Aug 12, 2025
  
  1327e3bb
- fix(build): Pin cuda-python>=12,<13 to avoid trtllm breakage (#2379) (#2396) · 7e4eec26
  Ryan McCormick authored Aug 12, 2025
  
  7e4eec26
- feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of... · 18bb779e
  KrishnanPrash authored Aug 12, 2025
```
feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of `nvext`) and Structured Output / Guided Decoding (#2380)
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
```
  18bb779e
- fix: Ensure Login to NGC step works (#2409) · 38cf0f8d
  Tushar Sharma authored Aug 12, 2025
  
  38cf0f8d
- feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68
  Hongkuan Zhou authored Aug 12, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  b4189c68
- fix: Pinned PyTorch version for vLLM container (#2359) · 89ede845
  Kris Hung authored Aug 11, 2025
  
  89ede845
11 Aug, 2025 10 commits
- feat: profiling PVC updates for better UX (#2402) · bea92eae
  hhzhang16 authored Aug 11, 2025
  
  bea92eae
- refactor: rename to system status server for consistency (#2354) · c91e2e49
  Keiven C authored Aug 11, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c91e2e49
- feat: standalone profiling script for a given endpoint (#2386) · fd358991
  Hongkuan Zhou authored Aug 11, 2025
  
  fd358991
- feat: add grove multinode support (#2269) · dabd2267
  julienmancuso authored Aug 11, 2025
  
  dabd2267
- docs: add sglang installation variants (#2400) · d51580a4
  ishandhanani authored Aug 11, 2025
  
  d51580a4
- fix: Fixes OPS-618 Add Access Token for accessing containers on NGC (#2395) · 4d24d03b
  Tushar Sharma authored Aug 11, 2025
  
  4d24d03b
- fix(preprocessor): Populate model ID in PreprocessedRequest (#2397) · c443528f
  Graham King authored Aug 11, 2025
  
  c443528f
- feat: cuda traits and interoperability with external contexts (#2340) · b5efb957
  Ryan Olson authored Aug 11, 2025
  
  b5efb957
- fix: use default batch_size for decode (#2376) · 43854732
  Neal Vaidya authored Aug 10, 2025
  
  43854732
- docs: add sglang hicache example and guide (#2388) · 3b722842
  Faradawn Yang authored Aug 10, 2025
  
  3b722842
08 Aug, 2025 4 commits
- docs: Update nixl_connect README (#2320) · fa4a7f1e
  J Wyman authored Aug 08, 2025
  
  fa4a7f1e
- docs: exporting metrics in k8s (dep-302) (#2271) · 5375af2c
  mohammedabdulwahhab authored Aug 08, 2025
  
  5375af2c
- fix: Copy cuda libraries from devel to runtime stage (#2301) · 77b53c41
  Tushar Sharma authored Aug 08, 2025
  
  77b53c41
- fix: use wheel files for installation in trtllm build (#2372) · 90ef3038
  Anant Sharma authored Aug 08, 2025
  
  90ef3038
07 Aug, 2025 3 commits
- docs: fix lowest cost mistake in doc (#2361) · f7e468c7
  Yan Ru Pei authored Aug 07, 2025
```
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
```
  f7e468c7
- feat: Router replicas with state-sharing (#2264) · 5166a3dd
  Yan Ru Pei authored Aug 07, 2025
  
  5166a3dd
- build: introduce dynamo base container (#2222) · 10f4302d
  Tushar Sharma authored Aug 07, 2025
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
```
  10f4302d