vllm/distributed/eplb/eplb_state.py · 67132945bbad23233fd583e6106ebebe859c8366 · OpenDAS / vllm_cscc

[Perf] Move eplb rebalance algo to async thread (#30888) · 67132945

Ilya Markov authored Feb 10, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

67132945

eplb_state.py 47.5 KB

Replace eplb_state.py