"git@developer.sourcefind.cn:gaoqiong/pybind11.git" did not exist on "f743bdf8e61b2dc4a8995a0485111bedd9c2cbb1"
-
Graham King authored
As a first step towards KV routing: - introduce a `--router-mode` in dynamo-run that only does random and round-robin right now. Not that interesting yet. - Make the vllm engine publish the KV events received from our patched vllm. Now we "just" need to connect the two. Easy right?
ec2e7307
