"vllm/config/__init__.py" did not exist on "cf8cc32674f30cc091b551ceb4decd79718ac9e5"
-
Yan Ru Pei authored
feat: Unnormalize waiting requests + predictive load updates for Python router (mirroring Rust) + softmax sampling to reduce thrashing (#1638)
8392e7a1
