Commits · c2dc85576943b7d0a0a95f5764baeeaa7a032919 · OpenDAS / dynamo

"lib/llm/src/entrypoint/input/common.rs" did not exist on "c7067fc2eca4f65d48acf4f4b78fd72c7488ac92"

27 Oct, 2025 3 commits
- docs: update version picker for 0.6.1 (#3906) · c2dc8557
  Kristen Kelleher authored Oct 27, 2025
  
  c2dc8557
- fix(nats): NATs queue should use streaming API otherwise KV events drop (#3900) · 76d96bb0
  Yan Ru Pei authored Oct 27, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  76d96bb0
- chore(discovery): Use Store interface instead of etcd (#3887) · 5a0d710b
  Graham King authored Oct 27, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  5a0d710b
25 Oct, 2025 1 commit
- fix: char boundary panic jail (#3893) · 6deeecb1
  ryan-lempka authored Oct 25, 2025
  
  6deeecb1
24 Oct, 2025 18 commits
- docs: initial trtllm recipe for qwen32b-fp8 (#3827) · 48b622c5
  Alec authored Oct 24, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  48b622c5
- fix: default when tools missing and minijinja length handling (#3880) · 818d72ae
  ryan-lempka authored Oct 24, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: ryan-lempka <rlempka@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  818d72ae
- fix: ignore stop key in vllm sampling params (#3879) · a79151c8
  ryan-lempka authored Oct 24, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  a79151c8
- fix: Fix sglang multimodal test (#3862) · 77cecf4e
  Kris Hung authored Oct 24, 2025
```
Signed-off-by: krishung5 <krish@nvidia.com>
```
  77cecf4e
- refactor: redesign the metrics API from Trait to composition to make the code... · cbe0b177
  Keiven C authored Oct 24, 2025
```
refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  cbe0b177
- ci: Try using docker driver instead of docker-container (#3824) · eb8d07cb
  Dillon Cullinan authored Oct 24, 2025
```
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
```
  eb8d07cb
- chore: mocker states do not need arc mutex (#3883) · d870d4b0
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d870d4b0
- fix: add the proper flag for mooncake benchmarking on router (#3878) · ee275cbf
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ee275cbf
- feat: python binding for kserve grpc frontend (#3739) · 9e5407f2
  zhongdaor-nv authored Oct 24, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  9e5407f2
- chore: don't error on failure to download snapshot (#3871) · 8d0a5eba
  Yan Ru Pei authored Oct 24, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  8d0a5eba
- refactor: move engine configs out of components directory (#3772) · 8354d325
  Anant Sharma authored Oct 24, 2025
```
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
```
  8354d325
- feat: Extend TensorRequest and TensorResponse to contains extra parameters (#3761) · 90caf3ea
  KrishnanPrash authored Oct 24, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  90caf3ea
- chore(runtime): Watched storage buckets now also return Delete events (#3875) · b77696da
  Graham King authored Oct 24, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  b77696da
- feat(sglang): experimental gb200 fp4 and updated gb200 fp8 commands (#3745) · 9defc01b
  ishandhanani authored Oct 23, 2025
  
  9defc01b
- fix: test case test_endpoint_health_check_notifier_created (#3863) · 7c208309
  Tzu-Ling Kan authored Oct 23, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  7c208309
- feat: add nats sink for audit logging (#3732) · cb0a3449
  ryan-lempka authored Oct 23, 2025
```
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
```
  cb0a3449
- feat: TensorRT-LLM and SGLang metrics validation (part 2/3 + 3/3) (#3842) · 3e015595
  Keiven C authored Oct 23, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3e015595
- fix: include request_id and error details in completions stream failure message (#3860) · 2f89c176
  zhongdaor-nv authored Oct 23, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  2f89c176
23 Oct, 2025 15 commits
- test: fix KV Router and KVBM tests in CI (#3848) · 5f98e91e
  Richard Huo authored Oct 23, 2025
  
  5f98e91e
- docs: include router benchmarking results (#3856) · 4e496691
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4e496691
- fix: sglang dsr1 recipes (#3850) · 640c2d30
  Hongkuan Zhou authored Oct 23, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  640c2d30
- fix: Check merge commit rather than head commit in docs-link-check.yml (#3851) · 8de469cf
  Nate Mailhot authored Oct 23, 2025
```
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
```
  8de469cf
- chore: Use KeyValueStoreManager instead of etcd::Client (#3822) · 7731b024
  Graham King authored Oct 23, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7731b024
- feat: remove component parameter from EPP (#3831) · 6f9be594
  atchernych authored Oct 23, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  6f9be594
- refactor: remove unused build args and update comments (#3688) · 3df1e8c2
  Keiven C authored Oct 23, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  3df1e8c2
- chore: restructure mocker cli args handling, to include prefill/decode (#3847) · 41ff394f
  Yan Ru Pei authored Oct 23, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  41ff394f
- feat: automatic profiling config generation (#3787) · a1b38af2
  Hongkuan Zhou authored Oct 23, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  a1b38af2
- refactor: kvbm modularity DIS-657 Eliminate ETCD from the leader-worker initialization (#3202) · 94aa2a7b
  Richard Huo authored Oct 23, 2025
```
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
```
  94aa2a7b
- fix: mpi flow and add resourceClaim (#3446) · 5d90e530
  Rohan Varma authored Oct 22, 2025
```
Signed-off-by: Rohan Varma <rohanv@nvidia.com>
```
  5d90e530
- fix: remove head commit checkout to instead use merge commit for docs-link… (#3840) · 2626126a
  Nate Mailhot authored Oct 22, 2025
```
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
```
  2626126a
- fix: update planner path after components restructure (#3614) · f6cb6cfd
  Hongkuan Zhou authored Oct 22, 2025
```
Signed-off-by: hongkuan <hongkuanz@nvidia.com>
```
  f6cb6cfd
- feat: add multiple _core*.so detection in sanity_check.py (#3803) · 73953c99
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  73953c99
- perf: cache compiled regex patterns in prometheus metrics filtering (#3825) · 7bb6368f
  Keiven C authored Oct 22, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  7bb6368f
22 Oct, 2025 3 commits

fix: revert change to aiperf output format (#3837) · fa45ff1f
Hongkuan Zhou authored Oct 22, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
fa45ff1f

docs: address Harry/VDR feedback + fixing broken links across repository (#3802) · c6b59045

Anish authored Oct 22, 2025


Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

c6b59045

feat: GKE examples (#2721) · d712ce8d

Biswa Panda authored Oct 22, 2025

Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: FortunaZhang <175659032+FortunaZhang@users.noreply.github.com>
Co-authored-by: FortunaZhang <175659032+FortunaZhang@users.noreply.github.com>

d712ce8d