Commits · 050906b5930768d03386fcc13259055fe6d41f5b · OpenDAS / dynamo

"vllm/vscode:/vscode.git/clone" did not exist on "19091efc44c6f9b1e008dc5469c63a1f01684745"

18 Jan, 2026 1 commit
- feat: track output tokens / blocks in the Router (optional) (#5452) · 050906b5
  Yan Ru Pei authored Jan 18, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  050906b5
15 Jan, 2026 1 commit
- feat: [router] serve worker KV query over dynamo endpoint instead of nats (#5451) · 7ebd5f82
  Biswa Panda authored Jan 15, 2026
  
  7ebd5f82
13 Jan, 2026 2 commits
- chore: Revert KVBM v2 transfer integration (#5406) · 9ca2923d
  jthomson04 authored Jan 13, 2026
  
  9ca2923d
- feat(model_card): Make bos_token_id optional (#5394) · dad42f42
  Graham King authored Jan 13, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  dad42f42
12 Jan, 2026 5 commits
- feat: allow router not assuming decode kv reuse (#5350) · 7fdc742e
  Yan Ru Pei authored Jan 12, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7fdc742e
- fix: Synchronizing on new thread to avoid delaing TRTLLM (#5333) · 329752d9
  Kyle McGill authored Jan 12, 2026
  
  329752d9
- fix: GB200 mem allocation failure (#5328) · e3c3a6b9
  Qi Wang authored Jan 12, 2026
  
  e3c3a6b9
- fix(llm): Send HF URLs to frontend not full paths (#5290) · f6ae58e3
  Graham King authored Jan 12, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  f6ae58e3
- fix(sglang): use external_trace_header API for distributed tracing (#5346) · cbbaa6b7
  ishandhanani authored Jan 13, 2026
```
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  cbbaa6b7
11 Jan, 2026 1 commit
- fix: get_body_limit() body limit size for response middleware. (#5268) · c94d097a
  Michael Feil authored Jan 11, 2026
```
Signed-off-by: michaelfeil <me@michaelfeil.eu>
```
  c94d097a
10 Jan, 2026 1 commit
- fix: fix bug in diffing logic in list_and_watch (#5318) · 2f9812aa
  mohammedabdulwahhab authored Jan 10, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  2f9812aa
09 Jan, 2026 3 commits
- test: Expand time range for flaky recorder test to improve stability (#5315) · 403ff669
  Ryan McCormick authored Jan 09, 2026
  
  403ff669
- perf: Fix prefill router round robin (#5313) · b39aa54f
  jthomson04 authored Jan 09, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  b39aa54f
- fix: KServe propagate error to client in stream infer (#5263) · bb8eaa23
  GuanLuo authored Jan 08, 2026
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  bb8eaa23
08 Jan, 2026 2 commits
- fix: preserve original model path for frontend config downloads (#5102) · f7ba417e
  ゆり authored Jan 09, 2026
```
Signed-off-by: yurekami <yurekami@users.noreply.github.com>
Co-authored-by: yurekami <yurekami@users.noreply.github.com>
```
  f7ba417e
- feat(vllm): Add prompt embeds support for pre-computed inference inputs (#4739) · 6f9619a2
  Wenqi Glantz authored Jan 08, 2026
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  6f9619a2
07 Jan, 2026 3 commits
- fix: vllm default behaviour for generation prompt (#5223) · b5a6b0db
  Ayush Agarwal authored Jan 07, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  b5a6b0db
- feat: Adding support for `response_format` field (#5127) · e994caeb
  KrishnanPrash authored Jan 07, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  e994caeb
- fix: return None for hidden stop tokens to prevent EOS in output (#5238) · 50af4cdc
  Chaitanya Malakala authored Jan 07, 2026
```
Signed-off-by: Chaitanya Malakala <106723863+chay1045@users.noreply.github.com>
```
  50af4cdc
06 Jan, 2026 2 commits
- feat: expected output tokens plumbing (#5181) · d9cc6f6b
  Yan Ru Pei authored Jan 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d9cc6f6b
- fix: block on notification of at least one runtime config (#5191) · cdeda221
  Yan Ru Pei authored Jan 05, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  cdeda221
05 Jan, 2026 1 commit

fix: record cached_tokens metric for non-streaming requests (#5193) · e7918716

Keiven C authored Jan 05, 2026


Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

e7918716

04 Jan, 2026 2 commits
- chore: remove unused codes (#5151) · e5502e78
  Kante Yin authored Jan 04, 2026
```
Signed-off-by: kerthcet <kerthcet@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
```
  e5502e78
- fix: block on KV subscriber initialization (#5149) · 43ba25bc
  Yan Ru Pei authored Jan 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  43ba25bc
03 Jan, 2026 2 commits
- feat: add continuous_usage_stats option for per-chunk usage (#5139) · 6bfb41de
  GuanLuo authored Jan 03, 2026
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
```
  6bfb41de
- feat: mockers with bootstrap optimization (sglang testing) + CI test (#5121) · 0980b27f
  Yan Ru Pei authored Jan 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  0980b27f
02 Jan, 2026 1 commit
- chore: update all copyright headers in repo to 2026 (#5130) · cf433e68
  Tushar Sharma authored Jan 02, 2026
```
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
```
  cf433e68
31 Dec, 2025 2 commits

fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106) · 0b33c1df

Yan Ru Pei authored Dec 31, 2025


Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

0b33c1df

fix: add chat_template_kwargs alias for compatibility (#5112) · cceeb8e3
Neelay Shah authored Dec 30, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
cceeb8e3

25 Dec, 2025 1 commit
- feat: Book-keeping bindings [DEP-689] (#5036) · 01f77f2c
  atchernych authored Dec 25, 2025
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  01f77f2c
24 Dec, 2025 2 commits
- feat: KVBM Object Support - add runtime vars for object (#5063) · 096699c4
  Patrick authored Dec 23, 2025
```
Signed-off-by: Patrick Riel <priel@nvidia.com>
```
  096699c4
- feat: KVBM Object Support - add to storage types (#5060) · 853151d9
  Patrick authored Dec 23, 2025
```
Signed-off-by: Patrick Riel <priel@nvidia.com>
```
  853151d9
22 Dec, 2025 1 commit
- feat: add auto-generated frontend OpenAPI spec and helper binary (#4802) · f63e273c
  smatta-star authored Dec 22, 2025
```
Signed-off-by: Satvik Matta <smatta@nvidia.com>
```
  f63e273c
19 Dec, 2025 7 commits
- chore: clean up PreprocessedRequest (#5040) · f4245c99
  Yan Ru Pei authored Dec 19, 2025
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f4245c99
- fix: Replace image_url block with empty image block to render image chat prompt template (#4854) · fc776f7d
  jh-nv authored Dec 19, 2025
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  fc776f7d
- feat: Request Migration Metrics (#5029) · e6a6a1f2
  Jacky authored Dec 19, 2025
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e6a6a1f2
- chore: update nixl to 0.8.0 and ucx 1.20 (#5007) · 910b587d
  Nate Mailhot authored Dec 19, 2025
```
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
```
  910b587d
- feat: Runtime media decoder config (#5011) · d2faf0e6
  milesial authored Dec 18, 2025
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  d2faf0e6
- feat: add multimodal support to KV router with standalone trtllm example (#4577) · 481dc636
  zhongdaor-nv authored Dec 18, 2025
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
```
  481dc636
- refactor: frontend/grpc tests to use dynamic ports (#4992) · c22280cc
  Keiven C authored Dec 18, 2025
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  c22280cc