Commit 218d105d authored by Leo Gao's avatar Leo Gao
Browse files

Test bootstrapping

parent c1822c02
import pytest
import lm_eval.metrics as metrics
def test_bootstrapping():
arr = list(range(100))
expected = metrics.mean_stderr(arr)
bootstrapped = metrics.bootstrap_stderr(metrics.mean, arr)
assert bootstrapped == pytest.approx(expected)
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment