Commits · b92c95937b1806d1fc3d3b05498ede0a60717783 · OpenDAS / dynamo

"lib/llm/src/vscode:/vscode.git/clone" did not exist on "2cf427ed8faf0680d1e8afe4d4399ba1a158a165"

15 Apr, 2026 4 commits
- fix(replay): drain traffic metrics only on throughput ticks (#8232) · b92c9593
  Hongkuan Zhou authored Apr 15, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b92c9593
- feat(kv-router): add prompt membership index for scheduler reads (#8175) · 134d484d
  Yan Ru Pei authored Apr 15, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  134d484d
- feat(replay): planner-in-the-loop offline replay (#8187) · 89d67172
  jthomson04 authored Apr 14, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  89d67172
- fix(trtllm): prevent decode worker segfault on prefill scale-down (#7933) · b13a440e
  MatejKosec authored Apr 14, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  b13a440e
14 Apr, 2026 4 commits
- feat: remove enable_nats usage (#7265) · af0ff07c
  Biswa Panda authored Apr 14, 2026
  
  af0ff07c
- fix(replay): short-circuit .npz planner imports (#8050) · 31909ca3
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  31909ca3
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
- fix(deps): pin mio after lockfile drift (#8080) · 20ce329b
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  20ce329b
13 Apr, 2026 2 commits
- feat: add KV cache transfer estimated latency metric for disaggregated serving (#7590) · 1ebe7060
  Jonathan Tong authored Apr 13, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  1ebe7060
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
11 Apr, 2026 1 commit
- feat: Request Migration disable on max seq len exceeded (#8020) · f6976e7f
  Jacky authored Apr 10, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  f6976e7f
08 Apr, 2026 7 commits
- fix(planner): avoid hang in wait_for_scaling_completion when no decision pending (#8008) · cab6323c
  jthomson04 authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  cab6323c
- feat: adding kvbm-engine (#6773) · 008683d6
  Ryan Olson authored Apr 08, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  008683d6
- refactor(3/3): switch dynamo-protocols to upstream async-openai types (#7625) · fd5cc288
  ishandhanani authored Apr 08, 2026
```
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  fd5cc288
- chore: Remove dependency memory -> config (#7993) · 0b7a18ce
  Graham King authored Apr 08, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  0b7a18ce
- feat(kv-router): split Dynamo-native remote indexer [DYN-2593] (#7973) · 49eb397a
  Yan Ru Pei authored Apr 07, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  49eb397a
- chore: fix bindings typo in comments (#7516) · 06513c9b
  Xianlu Bird authored Apr 08, 2026
```
Signed-off-by: xianlubird <xianlubird@gmail.com>
```
  06513c9b
- fix(nixl): fix iteration_count debug logging in _wait_for_completion_ (#7966) · 88966f02
  MatejKosec authored Apr 07, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  88966f02
07 Apr, 2026 1 commit
- feat: Request Rejection Frontend metrics (#7644) · 3205e7db
  Jacky authored Apr 06, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  3205e7db
06 Apr, 2026 4 commits
- fix: latch busy load until both cool off (#7912) · ffe20629
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: AmeenP <ameenp360@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: AmeenP <ameenp360@gmail.com>
```
  ffe20629
- chore(replay): refactor offline components into cleaner lanes (#7866) · 95a750f4
  Yan Ru Pei authored Apr 06, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  95a750f4
- feat(mocker): add MoE parallelism params to AIC perf model (#7856) · 3292ed1b
  Yongming Ding authored Apr 06, 2026
```
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
```
  3292ed1b
- chore: Missed cleanup, delete batch mode (#7873) · ac60a0e1
  Graham King authored Apr 06, 2026
```
Signed-off-by: Graham King <grahamk@nvidia.com>
```
  ac60a0e1
04 Apr, 2026 1 commit
- fix(kv-router): migrate raw zmq paths to libzmq and refresh lockfiles (#7871) · f849e1a6
  Yan Ru Pei authored Apr 04, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f849e1a6
03 Apr, 2026 1 commit
- chore(replay-optimize): quiet the sweep chatter (#7838) · 38b99369
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  38b99369
02 Apr, 2026 2 commits
- feat(replay): add agg/disagg offline replay optimization [DYN-2566] (#7774) · 4ea21079
  Yan Ru Pei authored Apr 02, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  4ea21079
- refactor(protocols): deprecate cache control (#7790) · c09ac697
  ishandhanani authored Apr 01, 2026
  
  c09ac697
01 Apr, 2026 3 commits
- refactor(2/3): rename dynamo-async-openai to dynamo-protocols (#7565) · b6a3b0c6
  ishandhanani authored Apr 01, 2026
  
  b6a3b0c6
- test(planner): isolate planner-family suites [DYN-2534] (#7723) · ab5a31b5
  Alec authored Mar 31, 2026
  
  ab5a31b5
- feat: add least-loaded router (#6314) · cc22114d
  kornelcsernai-harmonic authored Mar 31, 2026
```
Signed-off-by: Kornel Csernai <239206175+kornelcsernai-harmonic@users.noreply.github.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>
```
  cc22114d
31 Mar, 2026 4 commits
- test: split replay tests into a package (#7731) · 75c16393
  Yan Ru Pei authored Mar 31, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  75c16393
- test(replay): compare offline replay against AIC static point (#7729) · c4ef45bb
  Yan Ru Pei authored Mar 31, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  c4ef45bb
- feat: Add standardized Dynamo error types as Python exceptions (#7136) · 8ff0b6e7
  Tanmay Verma authored Mar 31, 2026
  
  8ff0b6e7
- chore(mocker): speed up replay hash hot paths (#7698) · 40768e9c
  Yan Ru Pei authored Mar 30, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  40768e9c
27 Mar, 2026 1 commit
- chore(mocker): batch live output signal sends (#7647) · a2154ba5
  Yan Ru Pei authored Mar 26, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  a2154ba5
26 Mar, 2026 1 commit
- refactor: load planner using new forwardpass metric and many improvements (#7351) · a58bcc31
  Hongkuan Zhou authored Mar 25, 2026
```
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
```
  a58bcc31
25 Mar, 2026 4 commits

feat(mocker): add offline disagg replay (#7617) · 02b1c58a
Yan Ru Pei authored Mar 25, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
02b1c58a

fix: strip tools from chat template when tool_choice=none (#7391) · 14a6122e

Yifan Jiang authored Mar 24, 2026

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

14a6122e

feat: add power-of-two-choices router mode (#7614) · db49dfd2
Aaron Batilo authored Mar 24, 2026
```
Signed-off-by: Aaron Batilo <abatilo@coreweave.com>
```
db49dfd2

fix: sglang eagle bigram tokens kv event report. (#6872) · 2fe37a51

huitian bai authored Mar 25, 2026


Signed-off-by: baihuitian <baihuitian.bht@gmail.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: PeaBrane <yanrpei@gmail.com>

2fe37a51