"...git@developer.sourcefind.cn:kecinstone/2024-pra-vllm.git" did not exist on "e0c6f556e85053059c74ab6b5cee396baf3b4316"
-
Owen Wang authored
Summary: Prediction count evaluator needs to gather it's state before computing metrics, otherwise when parallelized across N GPUs, we only get metrics computed from 1/N of the dataset, increasing our eval signal's variance. Reviewed By: wat3rBro Differential Revision: D27416864 fbshipit-source-id: b2c5334cd5a38bebcd06c6ace1627a6b71645fdd
cbdd46ab
