examples/python_rs/llm/vllm_nixl/kv_router.py · a954a1c60cdb5144f00e19c12fb146e7eb85c851 · OpenDAS / dynamo

feat: kv aware disagg router (#98) · a954a1c6

Hongkuan Zhou authored Mar 11, 2025


Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

a954a1c6

kv_router.py 8.5 KB

Replace kv_router.py