feat: kvbm + connector (#2258)

Signed-off-by: Ryan Olson <rolson@nvidia.com> Co-authored-by: Olga Andreeva <oandreeva@nvidia.com> Co-authored-by: Ziqi Fan <ziqif@nvidia.com> Co-authored-by: John Thompson <jothomson@nvidia.com> Co-authored-by: Richard Huo <rihuo@nvidia.com> Co-authored-by: Zicheng Ma <zichengm@nvidia.com>

feat: kvbm + connector (#2258)
Signed-off-by: Ryan Olson <rolson@nvidia.com> Co-authored-by: Olga Andreeva <oandreeva@nvidia.com> Co-authored-by: Ziqi Fan <ziqif@nvidia.com> Co-authored-by: John Thompson <jothomson@nvidia.com> Co-authored-by: Richard Huo <rihuo@nvidia.com> Co-authored-by: Zicheng Ma <zichengm@nvidia.com>
07cfc3a1 · Ryan Olson · GitHub · bf5862a1 · 07cfc3a1 · 07cfc3a1
Unverified Commit 07cfc3a1 authored Aug 19, 2025 by Ryan Olson Committed by GitHub Aug 19, 2025
20 changed files
--- a/lib/llm/src/block_manager/block/transfer/memcpy.rs
+++ b/lib/llm/src/block_manager/block/transfer/memcpy.rs
--- a/lib/llm/src/block_manager/block/transfer/nixl.rs
+++ b/lib/llm/src/block_manager/block/transfer/nixl.rs
--- a/lib/llm/src/block_manager/config.rs
+++ b/lib/llm/src/block_manager/config.rs
--- a/lib/llm/src/block_manager/connector.rs
+++ b/lib/llm/src/block_manager/connector.rs
--- a/lib/llm/src/block_manager/connector/protocol.rs
+++ b/lib/llm/src/block_manager/connector/protocol.rs
--- a/lib/llm/src/block_manager/connector/scheduler.rs
+++ b/lib/llm/src/block_manager/connector/scheduler.rs
--- a/lib/llm/src/block_manager/controller.rs
+++ b/lib/llm/src/block_manager/controller.rs
--- a/lib/llm/src/block_manager/controller/client.rs
+++ b/lib/llm/src/block_manager/controller/client.rs
--- a/lib/llm/src/block_manager/controller/handler.rs
+++ b/lib/llm/src/block_manager/controller/handler.rs
--- a/lib/llm/src/block_manager/distributed.rs
+++ b/lib/llm/src/block_manager/distributed.rs
--- a/lib/llm/src/block_manager/distributed/README.md
+++ b/lib/llm/src/block_manager/distributed/README.md
--- a/lib/llm/src/block_manager/distributed/leader.rs
+++ b/lib/llm/src/block_manager/distributed/leader.rs
--- a/lib/llm/src/block_manager/distributed/transfer.rs
+++ b/lib/llm/src/block_manager/distributed/transfer.rs
--- a/lib/llm/src/block_manager/distributed/utils.rs
+++ b/lib/llm/src/block_manager/distributed/utils.rs
--- a/lib/llm/src/block_manager/distributed/worker.rs
+++ b/lib/llm/src/block_manager/distributed/worker.rs
--- a/lib/llm/src/block_manager/distributed/zmq.rs
+++ b/lib/llm/src/block_manager/distributed/zmq.rs
--- a/lib/llm/src/block_manager/layout.rs
+++ b/lib/llm/src/block_manager/layout.rs
--- a/lib/llm/src/block_manager/layout/nixl.rs
+++ b/lib/llm/src/block_manager/layout/nixl.rs
--- a/lib/llm/src/block_manager/layout/utils.rs
+++ b/lib/llm/src/block_manager/layout/utils.rs
--- a/lib/llm/src/block_manager/offload.rs
+++ b/lib/llm/src/block_manager/offload.rs