Commits · 0c7068dda994f5fd1d6efac3abc8ce3ea8223800 · OpenDAS / dynamo

"lib/runtime/src/vscode:/vscode.git/clone" did not exist on "cab23f21b7a8b3a83556817fa9aa2f48f88ca359"

17 Apr, 2026 1 commit
- fix(replay/planner): planner-in-the-loop replay diagnostics + planner scaling logics fixes (#8280) · 0c7068dd
  Hongkuan Zhou authored Apr 17, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  0c7068dd
16 Apr, 2026 1 commit
- fix(runtime): lock-free TCP connection pool for OOM prevention and... · 6633be54
  Biswa Panda authored Apr 15, 2026
```
fix(runtime): lock-free TCP connection pool for OOM prevention and inflight/resource-leak fixes (#7806)
```
  6633be54
15 Apr, 2026 6 commits
- feat(planner): add advisory mode for scaling decisions (#8244) · 3da6f4d4
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  3da6f4d4
- chore: bump dynamo version numbers (#8191) · 01a4b6d6
  Harrison Saturley-Hall authored Apr 15, 2026
  
  01a4b6d6
- fix(replay): drain traffic metrics only on throughput ticks (#8232) · b92c9593
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b92c9593
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d
- feat(replay): planner-in-the-loop offline replay (#8187) · 89d67172
  jthomson04 authored Apr 14, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  89d67172
- fix(trtllm): prevent decode worker segfault on prefill scale-down (#7933) · b13a440e
  MatejKosec authored Apr 14, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  b13a440e
14 Apr, 2026 5 commits
- feat: remove enable_nats usage (#7265) · af0ff07c
  Biswa Panda authored Apr 14, 2026
  
  af0ff07c
- fix(kvbm): set CUDA device per rank before ncclCommInitRank (#8147) · 2263defc
  Alec authored Apr 14, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  2263defc
- fix(replay): short-circuit .npz planner imports (#8050) · 31909ca3
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  31909ca3
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
- fix(deps): pin mio after lockfile drift (#8080) · 20ce329b
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  20ce329b
13 Apr, 2026 3 commits
- feat: add KV cache transfer estimated latency metric for disaggregated serving (#7590) · 1ebe7060
  Jonathan Tong authored Apr 13, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  1ebe7060
- fix(kvbm): handle typed KvCacheConnectorConfig in consolidator check (#8117) · edce7d3d
  Alec authored Apr 13, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
```
  edce7d3d
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
11 Apr, 2026 1 commit
- feat: Request Migration disable on max seq len exceeded (#8020) · f6976e7f
  Jacky authored Apr 10, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  f6976e7f
08 Apr, 2026 9 commits
- fix(planner): avoid hang in wait_for_scaling_completion when no decision pending (#8008) · cab6323c
  jthomson04 authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  cab6323c
- feat: adding kvbm-engine (#6773) · 008683d6
  Ryan Olson authored Apr 08, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  008683d6
- feat(kvbm): add MLA support for DeepSeek-V2 and extend determinism tests (#7786) · ba34f131
  Olga Andreeva authored Apr 08, 2026
```
Signed-off-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: wz1qqx <ziqi.wang@novita.ai>
```
  ba34f131
- refactor(3/3): switch dynamo-protocols to upstream async-openai types (#7625) · fd5cc288
  ishandhanani authored Apr 08, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fd5cc288
- chore: Remove dependency memory -> config (#7993) · 0b7a18ce
  Graham King authored Apr 08, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0b7a18ce
- fix: dp_rank always 0 in non-KV router mode (#7984) · a210efa6
  ishandhanani authored Apr 08, 2026
  
  a210efa6
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
- chore: fix bindings typo in comments (#7516) · 06513c9b
  Xianlu Bird authored Apr 08, 2026
```
Signed-off-by: xianlubird <xianlubird@gmail.com>
```
  06513c9b
- fix(nixl): fix iteration_count debug logging in _wait_for_completion_ (#7966) · 88966f02
  MatejKosec authored Apr 07, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  88966f02
07 Apr, 2026 1 commit
- feat: Request Rejection Frontend metrics (#7644) · 3205e7db
  Jacky authored Apr 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  3205e7db
06 Apr, 2026 5 commits
- fix: latch busy load until both cool off (#7912) · ffe20629
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  ffe20629
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
- feat(mocker): add MoE parallelism params to AIC perf model (#7856) · 3292ed1b
  Yongming Ding authored Apr 06, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  3292ed1b
- feat(kvbm): KVBM MLA support optimization (#7015) · 1caf6659
  Aniket Kulkarni authored Apr 06, 2026
```
Signed-off-by: aknvda <anikkulkarni@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
```
  1caf6659
- chore: Missed cleanup, delete batch mode (#7873) · ac60a0e1
  Graham King authored Apr 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ac60a0e1
04 Apr, 2026 1 commit
- fix(kv-router): migrate raw zmq paths to libzmq and refresh lockfiles (#7871) · f849e1a6
  Yan Ru Pei authored Apr 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f849e1a6
03 Apr, 2026 1 commit
- chore(replay-optimize): quiet the sweep chatter (#7838) · 38b99369
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38b99369
02 Apr, 2026 3 commits
- feat: enable DP for GAIE (#7741) · 2b906504
  atchernych authored Apr 02, 2026
```
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
```
  2b906504
- feat(replay): add agg/disagg offline replay optimization [DYN-2566] (#7774) · 4ea21079
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4ea21079
- refactor(protocols): deprecate cache control (#7790) · c09ac697
  ishandhanani authored Apr 01, 2026
  
  c09ac697
01 Apr, 2026 3 commits
- refactor(2/3): rename dynamo-async-openai to dynamo-protocols (#7565) · b6a3b0c6
  ishandhanani authored Apr 01, 2026
  
  b6a3b0c6
- test(planner): isolate planner-family suites [DYN-2534] (#7723) · ab5a31b5
  Alec authored Mar 31, 2026
  
  ab5a31b5
- feat: add least-loaded router (#6314) · cc22114d
  kornelcsernai-harmonic authored Mar 31, 2026
```
Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  cc22114d