Unverified Commit 8d35dc43 authored by Tanmay Verma's avatar Tanmay Verma Committed by GitHub
Browse files

docs: Add documentation for UCX KV cache transfer in TRTLLM (#639)

parent 3fa35f9e
......@@ -151,4 +151,4 @@ Remaining tasks:
- [ ] Add multi-node support.
- [ ] Merge the code base with llm example to reduce the code duplication.
- [ ] Use processor from dynamo-llm framework.
- [ ] Explore NIXL integration with TensorRT-LLM.
- [ ] Enable NIXL integration with TensorRT-LLM once available. Currently, TensorRT-LLM uses UCX to transfer KV cache.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment