Unverified Commit 6b794c75 authored by Nicolò Lucchesi's avatar Nicolò Lucchesi Committed by GitHub
Browse files

[Nixl][CI] Fix tests (#22806)


Signed-off-by: default avatarNickLucche <nlucches@redhat.com>
parent 98deac38
......@@ -229,6 +229,9 @@ class FakeNixlConnectorWorker(NixlConnectorWorker):
num_blocks=1,
block_len=self.block_len,
attn_backend_name=self.backend_name,
# `self.kv_cache_layout` is only forced to HND when vllm engine
# is started. We mock HND here.
kv_cache_layout="HND",
),
remote_tp_size=remote_tp_size)
return {0: remote_agent_name}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment