Commits · 4b8826b36bbead614a344b1ba0fb26cfd8ef959c · OpenDAS / dynamo · GitLab

25 Mar, 2026 9 commits
- refactor(vllm): scope ray import to scale_elastic_ep, remove module-level ray state (#7618) · 4b8826b3
  Tzu-Ling Kan authored Mar 25, 2026
```
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  4b8826b3
- feat(sglang): disagg DP rank routing + backwards-compatible network imports (#6736) · 7edb07b5
  ishandhanani authored Mar 25, 2026
```
Co-authored-by: huitian bai <baihuitian.bht@gmail.com>
```
  7edb07b5
- fix: strip tools from chat template when tool_choice=none (#7391) · 14a6122e
  Yifan Jiang authored Mar 24, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  14a6122e
- docs: update the doc for vLLM agg serving to fit XPU (#7078) · 70e1ec1d
  Yi Yao authored Mar 25, 2026
```
Signed-off-by: Yi Yao <yi.a.yao@intel.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
```
  70e1ec1d
- perf: Miscellaneous router perf improvements (#7477) · 1368ccd6
  jthomson04 authored Mar 24, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1368ccd6
- fix(frontend): carry forward real stream metadata in JailedStream finalization (#7608) · 0adfd98d
  vvagias authored Mar 24, 2026
  
  0adfd98d
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
- fix: Request Rejection busy signal passage (#7615) · db79f324
  Jacky authored Mar 24, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  db79f324
24 Mar, 2026 15 commits
- docs(mocker): add link for the feature roadmap issue (#7610) · b6317af6
  Yongming Ding authored Mar 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  b6317af6
- feat(perf): add frontend performance sweep runner with full observability (#6749) · 01bf7170
  Biswa Panda authored Mar 24, 2026
  
  01bf7170
- chore(kv-router): share recovery cursor state (#7596) · 7389a369
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7389a369
- fix: expand docker metric fields (#7601) · a818a4bd
  Nate Mailhot authored Mar 24, 2026
  
  a818a4bd
- feat: remove localhost fallback from NIXL side-channel host detection (#6539) · ee3de9e4
  Alec authored Mar 24, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ee3de9e4
- feat(router): add best_worker indexer update flag (#7603) · 149bf5a2
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  149bf5a2
- feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route,... · daa4fb04
  Tzu-Ling Kan authored Mar 24, 2026
```
feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481)
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  daa4fb04
- feat: Add GAIE nightly integration test [DEP-423] (#7458) · 8c2a4681
  atchernych authored Mar 24, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  8c2a4681
- fix(replay): resolve planner_profile_data directory (#7586) · 16bca7b6
  Yongming Ding authored Mar 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  16bca7b6
- fix(docs): escape angle brackets in tilt-dev-setup to fix MDX parse error (#7599) · a58d2241
  dagil-nvidia authored Mar 24, 2026
```
Signed-off-by: Dan Gil <dagil@nvidia.com>
```
  a58d2241
- docs: clarify GAIE fallback and source installs (#7077) · 4c3e5991
  Daneyon Hansen authored Mar 24, 2026
```
Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
```
  4c3e5991
- feat(replay): add shared loadgen workload paths [DYN-2510] (#7593) · b2c59aa4
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b2c59aa4
- feat: remote_write to external DB for agent_* metrics (#7198) · 2b36b175
  alexanderbilk authored Mar 24, 2026
```
Signed-off-by: Aleksandr Bilkovskii <alexanderb@nvidia.com>
```
  2b36b175
- chore: remove deprecated automatic kv events config for vLLM LLM-94 (#7591) · 115512ef
  Alec authored Mar 23, 2026
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
```
  115512ef
- chore: Bump vLLM to 0.18.0 (#7584) · 3a1561fb
  Alec authored Mar 23, 2026
  
  3a1561fb
23 Mar, 2026 16 commits
- docs: remove unsupported --trace-file from mocker (#7585) · aaa8a567
  Yongming Ding authored Mar 23, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  aaa8a567
- fix: Don't double-count duplicate store events in the tree size. (#7549) · 52382c91
  jthomson04 authored Mar 23, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  52382c91
- test(mocker): cut replay helper sleeps (#7577) · d4e30a59
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d4e30a59
- feat(gms): e2e failover support for vLLM (#6818) · 1c65a588
  mohammedabdulwahhab authored Mar 23, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1c65a588
- chore: bump versions of operator base container and gRPC (#7525) · 8eb79979
  Harrison Saturley-Hall authored Mar 23, 2026
```
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
```
  8eb79979
- ci: convert framework image pipelines to single multi-arch manifest builds (#7399) · 20eee509
  Ran Rubin authored Mar 23, 2026
```
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
```
  20eee509
- chore(snapshot): gms + snapshot support (#7026) · b2aefc53
  Janelle Cai authored Mar 23, 2026
```
Signed-off-by: Janelle Cai <jcai18@mit.edu>
```
  b2aefc53
- docs: EKS Auto Mode example (#7369) · 9616c86f
  Erez Zarum authored Mar 23, 2026
```
Signed-off-by: Erez Zarum <erezz@amazon.com>
```
  9616c86f
- feat: Frontend and Runtime Request Cancellation Metrics (#7493) · e252f82d
  Jacky authored Mar 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e252f82d
- fix: ProphetPredictor next-step timestamp missing step_size fa… (#7208) · 4159c6fd
  liuhuijiayou authored Mar 24, 2026
```
Signed-off-by: liuhui <liuhui06@kuaishou.com>
Co-authored-by: liuhui <liuhui06@kuaishou.com>
```
  4159c6fd
- docs: removes the debug knob for kimi-k2.5 with specdec (#7576) · 56eb52ec
  yunzhoul-nv authored Mar 23, 2026
```
Signed-off-by: Yunzhou Liu <232973175+yunzhoul-nv@users.noreply.github.com>
```
  56eb52ec
- docs: add performance-optimized recipe detail for Kimi-K2.5 with Speculative... · 5631db75
  yunzhoul-nv authored Mar 23, 2026
```
docs: add performance-optimized recipe detail for Kimi-K2.5 with Speculative Decoding recipe (#7555)
Signed-off-by: Yunzhou Liu <232973175+yunzhoul-nv@users.noreply.github.com>
```
  5631db75
- fix: vllm forwardpass metric for async scheduling (#7537) · cbdab502
  Hongkuan Zhou authored Mar 23, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  cbdab502
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
- fix(snapshot): persist CUDA namespace PIDs in manifest (#7539) · ba9a8a9f
  Schwinn Saereesitthipitak authored Mar 23, 2026
  
  ba9a8a9f