vllm/distributed/eplb/async_worker.py · 67132945bbad23233fd583e6106ebebe859c8366 · OpenDAS / vllm_cscc

[Perf] Move eplb rebalance algo to async thread (#30888) · 67132945

Ilya Markov authored Feb 10, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

67132945

async_worker.py 7.63 KB

Replace async_worker.py