Commits · f0d3ce639aff1585b3e7012c7e9e7aa70096327f · OpenDAS / dynamo · GitLab

30 Mar, 2026 5 commits
- fix: Anthropic streaming double-parsing + reasoning_content roundtrip (#7358) · f0d3ce63
  MatejKosec authored Mar 30, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f0d3ce63
- refactor(1/3): move `nvext` to `dynamo-llm` and move `anthropic` to `dynamo-async-openai` (#7564) · 2887cd1c
  ishandhanani authored Mar 30, 2026
  
  2887cd1c
- feat(runtime): scope MDC checksum validation to per-WorkerSet (#7368) · d6136f4a
  Thomas Montfort authored Mar 30, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  d6136f4a
- fix: make sleep/wake errors fatal in failover mode and correct RO memory accounting (#7681) · a565f105
  mohammedabdulwahhab authored Mar 30, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  a565f105
- fix: downgrade noisy tool parser INFO logs to DEBUG (#7573) · 64c6eb66
  Ameen Patel authored Mar 30, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
```
  64c6eb66
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
26 Mar, 2026 1 commit
- refactor: load planner using new forwardpass metric and many improvements (#7351) · a58bcc31
  Hongkuan Zhou authored Mar 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a58bcc31
25 Mar, 2026 8 commits
- feat(mocker): add offline disagg replay (#7617) · 02b1c58a
  Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02b1c58a
- feat(sglang): disagg DP rank routing + backwards-compatible network imports (#6736) · 7edb07b5
  ishandhanani authored Mar 25, 2026
```
Co-authored-by: huitian bai <baihuitian.bht@gmail.com>
```
  7edb07b5
- fix: strip tools from chat template when tool_choice=none (#7391) · 14a6122e
  Yifan Jiang authored Mar 24, 2026
```
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  14a6122e
- perf: Miscellaneous router perf improvements (#7477) · 1368ccd6
  jthomson04 authored Mar 24, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  1368ccd6
- fix(frontend): carry forward real stream metadata in JailedStream finalization (#7608) · 0adfd98d
  vvagias authored Mar 24, 2026
  
  0adfd98d
- feat: add power-of-two-choices router mode (#7614) · db49dfd2
  Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
  db49dfd2
- fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51
  huitian bai authored Mar 25, 2026
```
Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  2fe37a51
- fix: Request Rejection busy signal passage (#7615) · db79f324
  Jacky authored Mar 24, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  db79f324
24 Mar, 2026 6 commits
- feat(perf): add frontend performance sweep runner with full observability (#6749) · 01bf7170
  Biswa Panda authored Mar 24, 2026
  
  01bf7170
- chore(kv-router): share recovery cursor state (#7596) · 7389a369
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  7389a369
- feat(router): add best_worker indexer update flag (#7603) · 149bf5a2
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  149bf5a2
- feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route,... · daa4fb04
  Tzu-Ling Kan authored Mar 24, 2026
```
feat(vllm): elastic EP scaling — ray.nodes() patch, scale_elastic_ep route, null-tolerant discovery (#7481)
Signed-off-by: tzulingk <tzulingk@nvidia.com>
```
  daa4fb04
- fix(replay): resolve planner_profile_data directory (#7586) · 16bca7b6
  Yongming Ding authored Mar 24, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  16bca7b6
- feat(replay): add shared loadgen workload paths [DYN-2510] (#7593) · b2c59aa4
  Yan Ru Pei authored Mar 24, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b2c59aa4
23 Mar, 2026 8 commits
- fix: Don't double-count duplicate store events in the tree size. (#7549) · 52382c91
  jthomson04 authored Mar 23, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
```
  52382c91
- test(mocker): cut replay helper sleeps (#7577) · d4e30a59
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  d4e30a59
- feat(gms): e2e failover support for vLLM (#6818) · 1c65a588
  mohammedabdulwahhab authored Mar 23, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
```
  1c65a588
- chore(snapshot): gms + snapshot support (#7026) · b2aefc53
  Janelle Cai authored Mar 23, 2026
```
Signed-off-by: Janelle Cai <jcai18@mit.edu>
```
  b2aefc53
- feat: Frontend and Runtime Request Cancellation Metrics (#7493) · e252f82d
  Jacky authored Mar 23, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  e252f82d
- feat(mocker): add multi-worker replay and router startup fixes (#7553) · b7fe46b1
  Yan Ru Pei authored Mar 23, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b7fe46b1
- feat(perf): add pipeline instrumentation and feature gated NVTX markers (#6746) · 82794761
  Biswa Panda authored Mar 23, 2026
  
  82794761
- feat: radix tree implementation (#7459) · ed4d8068
  Janelle Cai authored Mar 23, 2026
  
  ed4d8068
20 Mar, 2026 3 commits
- feat(mocker): integrate AIConfigurator for latency prediction (#7505) · 6b67c1c4
  Yongming Ding authored Mar 20, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  6b67c1c4
- feat(mocker): add offline trace replay mode [DYN-2502] (#7543) · c3908a36
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c3908a36
- feat(llm): unify user-facing priority hints (#7492) · ebd06a1f
  Yan Ru Pei authored Mar 20, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  ebd06a1f
19 Mar, 2026 5 commits
- feat: adding request and scheduled sequence (#6933) · 9ba5f828
  Ryan Olson authored Mar 19, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  9ba5f828
- feat: make the kvbm v1's MAX_CONCURRENT_TRANSFERS and MAX_TRANSFER_BATCH_SIZE... · e7bcf651
  Richard Huo authored Mar 19, 2026
```
feat: make the kvbm v1's MAX_CONCURRENT_TRANSFERS and MAX_TRANSFER_BATCH_SIZE configurable from env var (#7527)
```
  e7bcf651
- feat: enable mypy in pre-merge (#6732) · 2712426f
  jh-nv authored Mar 19, 2026
  
  2712426f
- fix: observability fixes for OTEL tracing and logging (#7240) · 9eee5354
  jh-nv authored Mar 19, 2026
```
Signed-off-by: Jie Hao <jihao@nvidia.com>
```
  9eee5354
- test: GAIE integration Unit and e2e tests (#7257) · 50af3435
  atchernych authored Mar 19, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  50af3435
17 Mar, 2026 3 commits
- feat(mocker): add SGLang engine simulation (#6977) · 930721c8
  Yongming Ding authored Mar 17, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  930721c8
- chore(kv-router): drop easy llm facade reexports (#7474) · 45be2fdc
  Yan Ru Pei authored Mar 17, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  45be2fdc
- feat: enable kvbm v1 to use the v2 ::new_with_device (#7151) · 5b6624bd
  Ryan Olson authored Mar 17, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  5b6624bd