@@ -61,10 +61,4 @@ To enable NIXL for KV cache transfer in disaggregated serving:
...
@@ -61,10 +61,4 @@ To enable NIXL for KV cache transfer in disaggregated serving:
4.**Send the request:**
4.**Send the request:**
See [client](./README.md#client) section to learn how to send the request to deployment.
See [client](./README.md#client) section to learn how to send the request to deployment.
**Important:** Ensure that ETCD and NATS services are running before starting the service.
**Important:** Ensure that ETCD and NATS services are running before starting the service.
\ No newline at end of file
The container will automatically configure the appropriate environment variables (`TRTLLM_USE_NIXL_KVCACHE=1`) when built with the NIXL flag. The same container image can be used to use UCX for KV cache transfer.