Commits · 2f6583271fcb1efacb56716cd25fa994e875f622 · OpenDAS / dynamo

"tests/planner/vscode:/vscode.git/clone" did not exist on "9573d34ca043c7f527becddd54b878f8878cb05a"

14 Apr, 2026 12 commits
- feat: per-container kube discovery for multi-engine pods (#8067) · 2f658327
  mohammedabdulwahhab authored Apr 14, 2026
```
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  2f658327
- test: reorganize and prune GPU Memory Service tests (#7828) · b78ec99a
  Schwinn Saereesitthipitak authored Apr 14, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  b78ec99a
- fix(runtime): graceful removal of disagg model from /v1/models when prefill engine dies (#7131) · d2aad651
  Biswa Panda authored Apr 14, 2026
  
  d2aad651
- feat(gms): exported GMS handles on allocation (#8108) · 49feb284
  Schwinn Saereesitthipitak authored Apr 13, 2026
  
  49feb284
- feat: add fasttokens benchmarks and tokenizer backend docs (#7388) · 8f4bd3b4
  Biswa Panda authored Apr 13, 2026
  
  8f4bd3b4
- fix(gms): restore default allocator cleanup before checkpoint (#8049) · 6f5b460c
  Schwinn Saereesitthipitak authored Apr 13, 2026
```
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
```
  6f5b460c
- fix(replay): short-circuit .npz planner imports (#8050) · 31909ca3
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  31909ca3
- feat(mocker): emit forward pass metrics to event plane for planner consumption (#8032) · 4e6c3964
  jthomson04 authored Apr 13, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  4e6c3964
- fix(kv-router): route pinned requests through scheduler (#8142) · 1142478a
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  1142478a
- feat: router, metric only add queue isl tokens (#8136) · eac6a5fc
  Michael Feil authored Apr 13, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  eac6a5fc
- feat: Decoder clean-up for handling incomplete multi-byte sequence (#8022) · 2cabf441
  Biswa Panda authored Apr 13, 2026
  
  2cabf441
- fix(deps): pin mio after lockfile drift (#8080) · 20ce329b
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  20ce329b
13 Apr, 2026 9 commits
- feat(sglang): add ephemeral KV session routing (#7665) · 9498f016
  ishandhanani authored Apr 13, 2026
```
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
```
  9498f016
- fix(kvbm): query NCCL version at runtime instead of hardcoding (#8130) · 47c4bd46
  Alec authored Apr 13, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
```
  47c4bd46
- feat: add KV cache transfer estimated latency metric for disaggregated serving (#7590) · 1ebe7060
  Jonathan Tong authored Apr 13, 2026
```
Signed-off-by: Jont828 <jt572@cornell.edu>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
```
  1ebe7060
- feat(runtime): add DYN_TCP_RESPONSE_STREAM_PORT/HOST env vars for configurable... · 3acdc0f8
  Biswa Panda authored Apr 13, 2026
```
feat(runtime): add DYN_TCP_RESPONSE_STREAM_PORT/HOST env vars for configurable response stream server port
```
  3acdc0f8
- fix: populate input_tokens in Anthropic streaming + add model retrieval endpoint (#7234) · f7fe8005
  MatejKosec authored Apr 13, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  f7fe8005
- fix(kvbm): handle typed KvCacheConnectorConfig in consolidator check (#8117) · edce7d3d
  Alec authored Apr 13, 2026
```
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
```
  edce7d3d
- feat: route requests by device type and load for sglang epd (#7215) · a7d51b39
  Wang, Yi authored Apr 14, 2026
```
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
```
  a7d51b39
- fix(kv-router): wake queue on remote lifecycle (#8097) · 36e8b8c8
  Yan Ru Pei authored Apr 13, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  36e8b8c8
- fix(frontend): classify cancelled requests as 499 instead of 500 (#8090) · 1284237e
  Thomas Montfort authored Apr 13, 2026
```
Signed-off-by: tmontfort <tmontfort@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  1284237e
11 Apr, 2026 3 commits
- fix: LoRA unregister drops all the LoRA variants that share the same ID (#8053) · 9efa460c
  Keiven C authored Apr 10, 2026
```
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
```
  9efa460c
- fix(llm): support reading eos_token_ids from tokenizer_config.json for models... · b425b65c
  Ryan McCormick authored Apr 10, 2026
```
fix(llm): support reading eos_token_ids from tokenizer_config.json for models like Qwen3.5 with <|im_end|> token (#8091)
```
  b425b65c
- feat: Request Migration disable on max seq len exceeded (#8020) · f6976e7f
  Jacky authored Apr 10, 2026
```
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
```
  f6976e7f
10 Apr, 2026 5 commits
- feat(frontend): ResponseTimeout error type with request-plane worker quarantine (#8011) · 7f8e88fb
  MatejKosec authored Apr 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  7f8e88fb
- fix(frontend): backend stream inactivity timeout to fix inflight gauge leak (#7929) · adae833e
  MatejKosec authored Apr 10, 2026
```
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
```
  adae833e
- fix: recovery etc order, full recovery, thundering herd on same worker ids in same order. (#8016) · 6b75d6b0
  Michael Feil authored Apr 10, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  6b75d6b0
- fix: prevent KV block leak from cancel during disagg KV transfer (#7489) · 9055b2d3
  Yuewei Na authored Apr 09, 2026
```
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
```
  9055b2d3
- fix: add worker dump throtteling (#8013) · 859bd6ea
  Michael Feil authored Apr 09, 2026
```
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
```
  859bd6ea
09 Apr, 2026 7 commits
- refactor: simplify GPU Memory Service integrations and module boundaries (#7875) · 39a6a240
  Schwinn Saereesitthipitak authored Apr 09, 2026
  
  39a6a240
- chore(kv-router): remove sharded indexer path (#8041) · 02666f04
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  02666f04
- fix(llm): preserve unresolved dp rank routing (#8000) · b579a772
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  b579a772
- fix(kv-router): coalesce worker recovery dumps (#8021) · f3d3a8b3
  Yan Ru Pei authored Apr 09, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  f3d3a8b3
- perf: avoid cloning content parts in gather_multi_modal_data (#8009) · f49df565
  KrishnanPrash authored Apr 08, 2026
  
  f49df565
- feat(kv-router): add dedup filter for duplicate vLLM KV block events (#8012) · 9b3e9249
  jthomson04 authored Apr 08, 2026
```
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  9b3e9249
- fix(llm): log routing input hashes for replay debug (#8017) · e45bb0fe
  Yan Ru Pei authored Apr 08, 2026
```
Signed-off-by: PeaBrane <yanrpei@gmail.com>
```
  e45bb0fe
08 Apr, 2026 4 commits
- fix(runtime): handle instance disappearance in push router transport resolution (#8007) · 8f9c9998
  jthomson04 authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  8f9c9998
- fix(planner): avoid hang in wait_for_scaling_completion when no decision pending (#8008) · cab6323c
  jthomson04 authored Apr 08, 2026
```
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  cab6323c
- feat: adding kvbm-engine (#6773) · 008683d6
  Ryan Olson authored Apr 08, 2026
```
Signed-off-by: Ryan Olson <rolson@nvidia.com>
```
  008683d6
- fix: tool call loss under speculative decoding (#7768) · f69580b0
  Oleg Zhelezniak authored Apr 08, 2026
```
Signed-off-by: jellysnack <oleg.jellysnack@gmail.com>
```
  f69580b0