Commits · 0b33c1dfa0c1c88b4c728e600aa62a1be594b0c6 · OpenDAS / dynamo

"vscode:/vscode.git/clone" did not exist on "f14f59c262a2c7d46a90046b348190c525dce775"

31 Dec, 2025 2 commits

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

fix: add chat_template_kwargs alias for compatibility (#5112) · cceeb8e3
Neelay Shah authored Dec 30, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
cceeb8e3

25 Dec, 2025 1 commit
- feat: Book-keeping bindings [DEP-689] (#5036) · 01f77f2c
  atchernych authored Dec 25, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  01f77f2c
24 Dec, 2025 2 commits
- feat: KVBM Object Support - add runtime vars for object (#5063) · 096699c4
  Patrick authored Dec 23, 2025
```
Signed-off-by: Patrick Riel <priel@nvidia.com>
```
  096699c4
- feat: KVBM Object Support - add to storage types (#5060) · 853151d9
  Patrick authored Dec 23, 2025
```
Signed-off-by: Patrick Riel <priel@nvidia.com>
```
  853151d9
22 Dec, 2025 1 commit
- feat: add auto-generated frontend OpenAPI spec and helper binary (#4802) · f63e273c
  smatta-star authored Dec 22, 2025
```
Signed-off-by: Satvik Matta <smatta@nvidia.com>
```
  f63e273c
19 Dec, 2025 6 commits
- chore: clean up PreprocessedRequest (#5040) · f4245c99
  Yan Ru Pei authored Dec 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f4245c99
- fix: Replace image_url block with empty image block to render image chat prompt template (#4854) · fc776f7d
  jh-nv authored Dec 19, 2025
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  fc776f7d
- feat: Request Migration Metrics (#5029) · e6a6a1f2
  Jacky authored Dec 19, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e6a6a1f2
- feat: Runtime media decoder config (#5011) · d2faf0e6
  milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  d2faf0e6
- feat: add multimodal support to KV router with standalone trtllm example (#4577) · 481dc636
  zhongdaor-nv authored Dec 18, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  481dc636
- refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc
  Keiven C authored Dec 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c22280cc
18 Dec, 2025 5 commits
- feat: unify per-request metric tracking (#5004) · 85b5c808
  Yan Ru Pei authored Dec 18, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  85b5c808
- fix: Don't recursively drop blocks in KVBM (#4995) · da59c6ae
  jthomson04 authored Dec 18, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  da59c6ae
- feat: support disag serving in GAIE [DEP-659] (#4756) · 15b49818
  atchernych authored Dec 18, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  15b49818
- chore: add frontend per-request logging via on_response callback (#4965) · aaed4f3b
  nv-nedelman-1 authored Dec 18, 2025
```
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
```
  aaed4f3b
- feat(frontend): First part of Python request handling (#4999) · da0f2fb8
  Graham King authored Dec 17, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  da0f2fb8
17 Dec, 2025 3 commits

feat: add frontend based prefill request routing for sglang (#4635) · 1c39e483

Sean SH Choi authored Dec 17, 2025


Signed-off-by: Sean Choi <sechoi@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

1c39e483

fix: make gap detection work e2e (#4993) · 0fba01c2
Yan Ru Pei authored Dec 16, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
0fba01c2
feat: Pass tool definitions to parsers (#4948) · ff7aea54
William Zhang authored Dec 16, 2025
```
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
```
ff7aea54

16 Dec, 2025 3 commits
- feat(frontend): Well-known prefix for validation errors (#4984) · 7043707e
  Graham King authored Dec 16, 2025
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  7043707e
- feat: graceful exit leading to 500 and connection errors -... · 54dcf3ad
  Michael Feil authored Dec 16, 2025
```
feat: graceful exit leading to 500 and connection errors - liveness-return-false if-cancelled (#4914)
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  54dcf3ad
- feat: video decoder in the frontend (#4719) · 74fcd4a9
  milesial authored Dec 16, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  74fcd4a9
15 Dec, 2025 1 commit
- feat: Mistral-3-large support (#4885) · 44a2cba9
  jthomson04 authored Dec 14, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  44a2cba9
13 Dec, 2025 1 commit
- feat: Support for field include_stop_str_in_output (#4924) · 45e881d3
  KrishnanPrash authored Dec 12, 2025
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  45e881d3
12 Dec, 2025 4 commits
- feat: support decentralized router with NATs core (#4921) · ef3027bd
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ef3027bd
- fix: cleaner prefill + decode discovery (#4927) · feb49914
  Yan Ru Pei authored Dec 12, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  feb49914
- fix: prefill discovery (#4911) · f790e921
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f790e921
- feat: DeepSeek V3.2 chat template support (#4797) · 1efc7d63
  Vladislav Nosivskoy authored Dec 12, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  1efc7d63
11 Dec, 2025 6 commits
- feat: use os assigned free port for tcp rpc (#4891) · 64a30d3d
  Biswa Panda authored Dec 11, 2025
  
  64a30d3d
- feat: worker-local KvIndexer in KvEventPublisher (#4519) · 33249945
  Karen Chung authored Dec 11, 2025
```
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  33249945
- feat: early rejection based on active prefill tokens (#4837) · 10b01b45
  Yan Ru Pei authored Dec 11, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  10b01b45
- feat: add cached tokens prometheus metric (#4534) · f8bb53c0
  Vladislav Nosivskoy authored Dec 11, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  f8bb53c0
- feat: include ttft and total request time in nvext (engine-agnostic) (#4880) · 2845aa1f
  Yan Ru Pei authored Dec 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Keiven C <213854356+keivenchang@users.noreply.github.com>
```
  2845aa1f
- fix: worker to graceful shutdown after finishing in-flight requests (#4838) · c8845b41
  Hongkuan Zhou authored Dec 10, 2025
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
```
  c8845b41
10 Dec, 2025 3 commits
- fix: Don't set min_tokens when ignore_eos is true (#4872) · 664b458a
  jthomson04 authored Dec 10, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  664b458a
- feat: non blocking radix snapshot upload (#4839) · c7ad78f3
  Yan Ru Pei authored Dec 10, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c7ad78f3
- feat: KVBM V2 optimized bounce buffer transfer + benchmark (#3947) · 01819b87
  jthomson04 authored Dec 09, 2025
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  01819b87
09 Dec, 2025 2 commits
- chore: cleanups of passing around prefill and decode worker ids (#4829) · 1e5b20b2
  Yan Ru Pei authored Dec 09, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1e5b20b2
- fix: backend error serialization and add HTTP status code detection (#4786) · 065f466e
  Tzu-Ling Kan authored Dec 09, 2025
```
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
```
  065f466e