Commits · 24a935e5129e8327108990cb516db8441875ab06 · OpenDAS / dynamo · GitLab

15 Aug, 2025 5 commits
- fix: remove add_labels in Component (#2458) · 24a935e5
  Keiven C authored Aug 15, 2025
  
  24a935e5
- feat: extract deploymentType as interface (#2405) · 72128596
  julienmancuso authored Aug 15, 2025
  
  72128596
- feat(metrics): add NATS client metrics to prometheus_metrics_fmt (#2292) · acbdabc4
  Keiven C authored Aug 14, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  acbdabc4
- fix: add fields documentation in CRDs (#2447) · 591f4d56
  julienmancuso authored Aug 14, 2025
  
  591f4d56
- chore: Rename tensorrtllm framework to trtllm (#2435) · a3d624a7
  Tanmay Verma authored Aug 14, 2025
  
  a3d624a7
14 Aug, 2025 11 commits
- fix: operator defaults (#2398) · 81c27803
  mohammedabdulwahhab authored Aug 14, 2025
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  81c27803
- perf: Only compute checksums on debug builds (#2446) · 9ddb3efd
  jthomson04 authored Aug 14, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  9ddb3efd
- feat: Add a "model" label to Component metrics (#2389) · 3a3f5bf2
  Tzu-Ling Kan authored Aug 14, 2025
  
  3a3f5bf2
- feat: add RuntimeConfig to ModelEntry (#2311) · d0a63635
  Jorge António authored Aug 14, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  d0a63635
- fix: add instruction to deploy model with inference gateway (#2257) · b74b887b
  Biswa Panda authored Aug 14, 2025
  
  b74b887b
- build: Pin torch versions and skip lmcache installation for ARM build (#2430) · 8f24c027
  Kris Hung authored Aug 14, 2025
  
  8f24c027
- chore: deprecate sentencepiece tokenizer in lib/llm (#2439) · e71f71f4
  Lanqing Yang authored Aug 14, 2025
```
Signed-off-by: lyang24 <lanqingy93@gmail.com>
```
  e71f71f4
- feat: logprob handling (#2426) · f476fd74
  Greg Clark authored Aug 14, 2025
```
Signed-off-by: Greg Clark <grclark@nvidia.com>
```
  f476fd74
- chore: Upgrade volcano dependency version (#2442) · 5816c082
  Jesse Stutler authored Aug 14, 2025
```
Signed-off-by: jessestutler <jesseincomparable@hotmail.com>
```
  5816c082
- fix: Update gpt-oss.md w/ HF CLI pip install (#2431) · 20ad730c
  Anish authored Aug 13, 2025
```
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
```
  20ad730c
- feat: add dynamo environment checker script (#2419) · da1bf521
  Keiven C authored Aug 13, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  da1bf521
13 Aug, 2025 12 commits
- fix(ci): Reduce the free gpu memory fraction (#2433) · f6fef485
  Tanmay Verma authored Aug 13, 2025
  
  f6fef485
- feat: Add vars to multi-node trtllm slurm scripts to support xP yD deployments (#2429) · cebe9219
  Ryan McCormick authored Aug 13, 2025
  
  cebe9219
- fix: Fix ETCD and NATS starvation under massive request concurrency (#2384) · dcfa87be
  jthomson04 authored Aug 13, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  dcfa87be
- feat: enable custom metrics prefix (#2432) · 3411bda8
  ryan-lempka authored Aug 13, 2025
  
  3411bda8
- chore: Refactor tool calling for wider support in the future (#2393) · 086ea4f0
  Elyas Mehtabuddin authored Aug 13, 2025
  
  086ea4f0
- fix: upgrade cudarc to 0.17.1 (#2341) · c12c2578
  Dan Aloni authored Aug 13, 2025
```
Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
```
  c12c2578
- fix: Add detokenize stream (#2413) · 8c40bbb0
  jthomson04 authored Aug 13, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  8c40bbb0
- test: add kv routing test for sglang (#2424) · c0ed76da
  ishandhanani authored Aug 13, 2025
```
Signed-off-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
```
  c0ed76da
- feat: LLM metrics for non-streaming requests in frontend (#2427) · c3ecaf6c
  Hongkuan Zhou authored Aug 13, 2025
  
  c3ecaf6c
- feat: Allow an endpoint to serve multiple models (#2418) · 72ec5f5c
  Graham King authored Aug 13, 2025
  
  72ec5f5c
- chore: update wideep dockerfile for sgl to newest rel (#2422) · ebc84d6c
  ishandhanani authored Aug 12, 2025
  
  ebc84d6c
- feat: support sglang in sla planner (#2421) · e22f84ab
  Hongkuan Zhou authored Aug 12, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  e22f84ab
12 Aug, 2025 7 commits
- feat: multi-modal example with vLLM v1 and UX v2 (#2040) · 9b87c89c
  GuanLuo authored Aug 12, 2025
```
Co-authored-by: krishung5 <krish@nvidia.com>
```
  9b87c89c
- feat: Add performance sweeps for DeepSeek R1 on GB200 (#2387) · 1327e3bb
  Tanmay Verma authored Aug 12, 2025
  
  1327e3bb
- fix(build): Pin cuda-python>=12,<13 to avoid trtllm breakage (#2379) (#2396) · 7e4eec26
  Ryan McCormick authored Aug 12, 2025
  
  7e4eec26
- feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of... · 18bb779e
  KrishnanPrash authored Aug 12, 2025
```
feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of `nvext`) and Structured Output / Guided Decoding (#2380)
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
```
  18bb779e
- fix: Ensure Login to NGC step works (#2409) · 38cf0f8d
  Tushar Sharma authored Aug 12, 2025
  
  38cf0f8d
- feat: support SGLang in pre-deployment sweeping (#2360) · b4189c68
  Hongkuan Zhou authored Aug 12, 2025
```
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  b4189c68
- fix: Pinned PyTorch version for vLLM container (#2359) · 89ede845
  Kris Hung authored Aug 11, 2025
  
  89ede845
11 Aug, 2025 5 commits
- feat: profiling PVC updates for better UX (#2402) · bea92eae
  hhzhang16 authored Aug 11, 2025
  
  bea92eae
- refactor: rename to system status server for consistency (#2354) · c91e2e49
  Keiven C authored Aug 11, 2025
```
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c91e2e49
- feat: standalone profiling script for a given endpoint (#2386) · fd358991
  Hongkuan Zhou authored Aug 11, 2025
  
  fd358991
- feat: add grove multinode support (#2269) · dabd2267
  julienmancuso authored Aug 11, 2025
  
  dabd2267
- docs: add sglang installation variants (#2400) · d51580a4
  ishandhanani authored Aug 11, 2025
  
  d51580a4