Skip to content

GitLab

Unverified Commit f9eca2c8 authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

Add accuracy metric to crows-pairs (#380) 

* add accuracy metric to crows-pairs
parent ea3df930
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
tests/testdata/crows_pairs_french_religion-v0-res.json
View file @ f9eca2c8
{"results": {"crows_pairs_french_religion": {"likelihood_difference": 0.32691651640972225, "likelihood_difference_stderr": 0.021833493193249474}}, "versions": {"crows_pairs_french_religion": 0}}
\ No newline at end of file
{"results": {"crows_pairs_french_religion": {"likelihood_difference": 0.32691651640972225, "likelihood_difference_stderr": 0.021833493193249474, "pct_stereotype": 0.45217391304347826, "pct_stereotype_stderr": 0.046614569799583463}}, "versions": {"crows_pairs_french_religion": 0}}
\ No newline at end of file
tests/testdata/crows_pairs_french_sexual_orientation-v0-res.json
View file @ f9eca2c8
{"results": {"crows_pairs_french_sexual_orientation": {"likelihood_difference": 0.3160680928470684, "likelihood_difference_stderr": 0.02397758321605678}}, "versions": {"crows_pairs_french_sexual_orientation": 0}}
\ No newline at end of file
{"results": {"crows_pairs_french_sexual_orientation": {"likelihood_difference": 0.3160680928470684, "likelihood_difference_stderr": 0.02397758321605678, "pct_stereotype": 0.43956043956043955, "pct_stereotype_stderr": 0.05231815698566189}}, "versions": {"crows_pairs_french_sexual_orientation": 0}}
\ No newline at end of file
tests/testdata/crows_pairs_french_socioeconomic-v0-res.json
View file @ f9eca2c8
{"results": {"crows_pairs_french_socioeconomic": {"likelihood_difference": 0.3394681494647815, "likelihood_difference_stderr": 0.01702488895584347}}, "versions": {"crows_pairs_french_socioeconomic": 0}}
\ No newline at end of file
{"results": {"crows_pairs_french_socioeconomic": {"likelihood_difference": 0.3394681494647815, "likelihood_difference_stderr": 0.01702488895584347, "pct_stereotype": 0.4642857142857143, "pct_stereotype_stderr": 0.035714285714285705}}, "versions": {"crows_pairs_french_socioeconomic": 0}}
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment