Commits · 95c45509ea917c0ea5697edf259df10445eeffac · OpenDAS / dynamo

"lib/llm/vscode:/vscode.git/clone" did not exist on "78a3fedab9010d02032430c90fab9270c745ae09"

31 Mar, 2026 1 commit
- refactor: restructure planner package into subpackage hierarchy (#7689) · 95c45509
  Hongkuan Zhou authored Mar 30, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  95c45509
30 Mar, 2026 12 commits
- test(mocker): relax flaky online max-in-flight checks (#7688) · 68628976
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  68628976
- chore: bump to vllm_omni 0.18.0 (#7685) · 19447d66
  Ayush Agarwal authored Mar 30, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  19447d66
- docs(crates): add readmes for mocker and kv-router [DYN-2456] (#7687) · db54ca2f
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  db54ca2f
- fix: Anthropic streaming double-parsing + reasoning_content roundtrip (#7358) · f0d3ce63
  MatejKosec authored Mar 30, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f0d3ce63
- fix: remove omni dependency from dynamo.vllm path (#7683) · d58a6881
  Ayush Agarwal authored Mar 30, 2026
```
Signed-off-by: ayushag <ayushag@nvidia.com>
```
  d58a6881
- fix: race condition in multi modal PD worker (#7679) · f6e5023b
  Sergey Plotnikov authored Mar 30, 2026
```
Signed-off-by: Sergey Plotnikov <sergey.plotnikov@intel.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  f6e5023b
- chore: Advance to Tensorrt-LLM 1.3.0rc9 (#7635) · 9d54ee00
  Tanmay Verma authored Mar 30, 2026
```
Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>
```
  9d54ee00
- refactor(1/3): move `nvext` to `dynamo-llm` and move `anthropic` to `dynamo-async-openai` (#7564) · 2887cd1c
  ishandhanani authored Mar 30, 2026
  
  2887cd1c
- feat(runtime): scope MDC checksum validation to per-WorkerSet (#7368) · d6136f4a
  Thomas Montfort authored Mar 30, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d6136f4a
- fix: make sleep/wake errors fatal in failover mode and correct RO memory accounting (#7681) · a565f105
  mohammedabdulwahhab authored Mar 30, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  a565f105
- fix: downgrade noisy tool parser INFO logs to DEBUG (#7573) · 64c6eb66
  Ameen Patel authored Mar 30, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
```
  64c6eb66
- ci: run scoped mypy on backend-only PRs (#7636) · 0b0879dd
  KrishnanPrash authored Mar 30, 2026
```
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
```
  0b0879dd
28 Mar, 2026 2 commits
- feat: Support a dynamic default max_tokens for TensorRT-LLM backend (#5152) · 98d0ce91
  Steven Murr authored Mar 27, 2026
```
Signed-off-by: Steven Murr <stevemurr@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  98d0ce91
- chore: remove stale example assets (#7059) · 7dfbe4fd
  Alec authored Mar 27, 2026
  
  7dfbe4fd
27 Mar, 2026 2 commits
- feat: add Intel XPU deployment templates with Kubernetes DRA support (#7464) · 310f8ca9
  Yao Qing authored Mar 27, 2026
```
Signed-off-by: Yao, Qing <qing.yao@intel.com>
```
  310f8ca9
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
26 Mar, 2026 3 commits
- feat: Update XPU dockerfile with vllm-v0.17.1 (#7500) · 06f17011
  ZhengHongming888 authored Mar 26, 2026
```
Signed-off-by: Hongming Zheng <hongming.zheng@intel.com>
Co-authored-by: Zhan Xue <zhan.xue@intel.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  06f17011
- refactor: load planner using new forwardpass metric and many improvements (#7351) · a58bcc31
  Hongkuan Zhou authored Mar 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a58bcc31
- feat: add GPUDirect support for intel xpu on Dynamo (#5852) · db14d63f
  Sihan Chen authored Mar 26, 2026
```
Signed-off-by: Spycsh <sihan.chen@intel.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  db14d63f
25 Mar, 2026 14 commits
- chore(test): introduce xpu_1 and xpu_2 pytest markers (#7414) · c7b2d2b3
  VincyZhang authored Mar 26, 2026
```
Signed-off-by: VincyZhang <wenxin.zhang@intel.com>
```
  c7b2d2b3
- fix(docs): restore comm-stack diagram outer zone dimensions (#7640) · 50364d25
  dagil-nvidia authored Mar 25, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  50364d25
- docs: add SVG diagrams to disaggregated inference communication guide (#7638) · c1560ac9
  dagil-nvidia authored Mar 25, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  c1560ac9
- docs: Add disaggregated inference communication guide for Kubernetes (#6370) · bf61a5df
  rwipfelnv authored Mar 25, 2026
```
Signed-off-by: rwipfelnv <rwipfel@nvidia.com>
```
  bf61a5df
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
- refactor(vllm): scope ray import to scale_elastic_ep, remove module-level ray state (#7618) · 4b8826b3
  Tzu-Ling Kan authored Mar 25, 2026
```
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  4b8826b3
- feat(sglang): disagg DP rank routing + backwards-compatible network imports (#6736) · 7edb07b5
  ishandhanani authored Mar 25, 2026
```
Co-authored-by: huitian bai <baihuitian.bht@gmail.com>
```
  7edb07b5
- fix: strip tools from chat template when tool_choice=none (#7391) · 14a6122e
  Yifan Jiang authored Mar 24, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  14a6122e
- docs: update the doc for vLLM agg serving to fit XPU (#7078) · 70e1ec1d
  Yi Yao authored Mar 25, 2026
```
Signed-off-by: Yi Yao <yi.a.yao@intel.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  70e1ec1d
- perf: Miscellaneous router perf improvements (#7477) · 1368ccd6
  jthomson04 authored Mar 24, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1368ccd6
- fix(frontend): carry forward real stream metadata in JailedStream finalization (#7608) · 0adfd98d
  vvagias authored Mar 24, 2026
  
  0adfd98d
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
- fix: Request Rejection busy signal passage (#7615) · db79f324
  Jacky authored Mar 24, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  db79f324
24 Mar, 2026 6 commits
- docs(mocker): add link for the feature roadmap issue (#7610) · b6317af6
  Yongming Ding authored Mar 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  b6317af6
- feat(perf): add frontend performance sweep runner with full observability (#6749) · 01bf7170
  Biswa Panda authored Mar 24, 2026
  
  01bf7170
- chore(kv-router): share recovery cursor state (#7596) · 7389a369
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7389a369
- fix: expand docker metric fields (#7601) · a818a4bd
  Nate Mailhot authored Mar 24, 2026
  
  a818a4bd
- feat: remove localhost fallback from NIXL side-channel host detection (#6539) · ee3de9e4
  Alec authored Mar 24, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ee3de9e4
- feat(router): add best_worker indexer update flag (#7603) · 149bf5a2
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  149bf5a2