"launch/dynemo-run/Cargo.lock" did not exist on "531636933db8dd3a3ba4292d4eb00379fe702a44"
-
Graham King authored
As a first step towards KV routing: - introduce a `--router-mode` in dynamo-run that only does random and round-robin right now. Not that interesting yet. - Make the vllm engine publish the KV events received from our patched vllm. Now we "just" need to connect the two. Easy right?
ec2e7307
