Commits · 6216ae55fc5d415be60f59ad6c2df51b801f0eba · OpenDAS / dynamo

"cacheflow/engine/tokenizer_utils.py" did not exist on "e38074b1e6ad0975acbfa15d858c4bd7cd005e99"

04 Mar, 2026 10 commits
- chore: add mypy typing for profiler (#6863) · 6216ae55
  jh-nv authored Mar 04, 2026
  
  6216ae55
- chore: add mypy for router (#6864) · a96f5d73
  jh-nv authored Mar 04, 2026
  
  a96f5d73
- fix: remove empty multimodal input to avoid invalid uuid check in vLLM (#6853) · 2ae9c290
  GuanLuo authored Mar 04, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  2ae9c290
- fix: strip None args when profiler generating configs (#6882) · 19e8a165
  Hongkuan Zhou authored Mar 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  19e8a165
- fix(trtllm): remove deprecated beam_width from health check payload (#6879) · bb79b7de
  Tzu-Ling Kan authored Mar 04, 2026
```
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  bb79b7de
- feat: multi-image in request support for sglang backend (#6068) · adc95380
  Wang, Yi authored Mar 05, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  adc95380
- docs: add readme in component directory (#6699) · 203249e1
  jh-nv authored Mar 04, 2026
  
  203249e1
- fix: refactor profiler's dgd generation workflow to correctly generate mocker config (#6848) · 7c1a6238
  Hongkuan Zhou authored Mar 04, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  7c1a6238
- fix(frontend): vllm processor works with stream_interval > 1 (#6816) · 4e1bd700
  Graham King authored Mar 04, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  4e1bd700
- chore: better error message for planner sweeping mode (#6844) · d688aa68
  Hongkuan Zhou authored Mar 03, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  d688aa68
03 Mar, 2026 6 commits
- fix: properly setup and register vLLM worker for external / hybrid load... · 90d74637
  GuanLuo authored Mar 03, 2026
```
fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695)
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  90d74637
- chore(kv-router): deduplicate KvRouterConfig args into shared ArgGroup (#6805) · 9f3b7b33
  Yan Ru Pei authored Mar 03, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  9f3b7b33
- feat: use model_fields_set to distinguish ttft/itl default usage (#6814) · e4601811
  hhzhang16 authored Mar 03, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  e4601811
- fix(frontend): Update vllm processor for vllm 0.16 (#6799) · 56212b49
  Graham King authored Mar 03, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  56212b49
- feat: FlexKV integration in Dynamo (#5858) · 4d7c9845
  Yue Yu authored Mar 03, 2026
```
Signed-off-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>
```
  4d7c9845
- fix: Fix E + PD Multimodal Flow in trtllm (#6726) · 47ed1227
  Indrajit Bhosale authored Mar 02, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  47ed1227
02 Mar, 2026 3 commits
- fix(perf): add embedding transfer implementation with NIXL WRITE initiation (#6651) · 2cab0f7f
  GuanLuo authored Mar 02, 2026
```
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
```
  2cab0f7f
- fix: handle missing `out_hidden_size` for LLaVA models in EPD encode worker (#6759) · 63070ddf
  KrishnanPrash authored Mar 02, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  63070ddf
- docs: restructure docs directory and move fern config to fern/ (#6700) · ece08dc9
  Neal Vaidya authored Mar 01, 2026
```
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ece08dc9
27 Feb, 2026 6 commits
- fix: AutoApply bool --> AutoApply *bool (#6683) · 35c30493
  hhzhang16 authored Feb 27, 2026
```
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  35c30493
- docs: V1beta1 dgdr docs (#6647) · d8b7d394
  Ashna Mehrotra authored Feb 27, 2026
```
Signed-off-by: ashnamehrotra <ashnamehrotra@gmail.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
```
  d8b7d394
- feat: default router_event_threads to 4 (#6672) · 55c0a769
  Yan Ru Pei authored Feb 27, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  55c0a769
- chore: remove costly logs in EPD (#6696) · 1bde94d4
  Qi Wang authored Feb 27, 2026
  
  1bde94d4
- fix: proper DGD prefix for naive fallback in DGDR (#6667) · 76d887bc
  Hongkuan Zhou authored Feb 27, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  76d887bc
- feat: wire nvext.cache_control TTL-based pinning through Dynamo router (#6213) · f1d5c95a
  ishandhanani authored Feb 26, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  f1d5c95a
26 Feb, 2026 8 commits
- chore(deps): bump vLLM to 0.16.0 (#6614) · 64574a3e
  Alec authored Feb 26, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  64574a3e
- fix: guided decoding arg placement, None guard, test cleanup (#6617) · 1e44ab95
  Yifan Jiang authored Feb 26, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
```
  1e44ab95
- chore: Decouple TLLM_LOG_LEVEL with DYN_LOG (#6606) · 4a71926d
  Tanmay Verma authored Feb 25, 2026
  
  4a71926d
- feat: add guided decoding backend config and choice support for TRT-LLM (#5762) · 01ecc8c7
  Yifan Jiang authored Feb 25, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
```
  01ecc8c7
- feat: Update TRTLLM video diffusion for `visual_gen` module restructuring (PR #11462) (#6516) · 8de1c3e0
  Indrajit Bhosale authored Feb 25, 2026
```
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
```
  8de1c3e0
- refactor: move core logics of DPP -> AIC and support static profiling (#6285) · 4c648b11
  Hongkuan Zhou authored Feb 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
```
  4c648b11
- fix: Forward stream_options through multimodal request pipeline (#6474) · f6d4351f
  Blake Ledden authored Feb 25, 2026
```
Signed-off-by: Blake Ledden <blake.ledden@gmail.com>
```
  f6d4351f
- feat: enable returning routed experts info up through sglang (#6137) · 4960dbb3
  William Arnold authored Feb 25, 2026
```
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
```
  4960dbb3
25 Feb, 2026 7 commits
- fix: add periodic vLLM engine stats logging and fix log routing (#6566) · e1078789
  Alec authored Feb 25, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  e1078789
- feat(sglang): add checkpoint/restore support for chrek (#6594) · 5a7ead2b
  Schwinn Saereesitthipitak authored Feb 25, 2026
```
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
```
  5a7ead2b
- fix: optimize uuid calculation (#6596) · 49eca14b
  zhongdaor-nv authored Feb 25, 2026
```
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
```
  49eca14b
- feat: throughput-metrics-source for SLA planner + GlobalPlanner disagg scaling (#6500) · 651ef5b5
  daiyaanarfeen authored Feb 25, 2026
```
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
```
  651ef5b5
- perf: Keep embeddings on GPU Embedding Sender in EPD pipeline + minor fixes (#6535) · 80955ef4
  Kris Hung authored Feb 25, 2026
  
  80955ef4
- feat(mocker): add KV cache transfer latency for disagg serving (#6504) · 5d958623
  Yongming Ding authored Feb 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  5d958623
- feat: add ZMQ KV event publishing to mocker [DYN-2221] (#6528) · 65dc451d
  Yan Ru Pei authored Feb 24, 2026
```
Signed-off-by: Ru Pei <rupei@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  65dc451d