Unverified Commit 7ead8b71 authored by Suman Tatiraju's avatar Suman Tatiraju Committed by GitHub
Browse files

docs: Add Kvbm documentation for connector API integrations [DYN-1052] (#3578)


Signed-off-by: default avatarSuman Tatiraju <statiraju@nvidia.com>
Signed-off-by: default avatarakshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: default avatarakshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: default avatarcoderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: default avatarZiqi Fan <ziqif@nvidia.com>
parent 5fb661a5
......@@ -17,9 +17,9 @@ limitations under the License.
# Running KVBM in vLLM
This guide explains how to leverage KVBM (KV Block Manager) to mange KV cache and do KV offloading in vLLM.
This guide explains how to leverage KVBM (KV Block Manager) to manage KV cache and do KV offloading in vLLM.
To learn what KVBM is, please check [here](https://docs.nvidia.com/dynamo/latest/kvbm/kvbm_intro.html)
To learn what KVBM is, please check [here](kvbm_architecture.md)
## Quick Start
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment