Commit f9cc0267 authored by Leo Gao's avatar Leo Gao
Browse files

Use hashed version stability test instead

parent 10d4b64a
[["Question: Which is the function of the gallbladder?\nAnswer:", " store bile"], ["Question: Which is the function of the gallbladder?\nAnswer:", " produce bile"], ["Question: Which is the function of the gallbladder?\nAnswer:", " store digestive enzymes"], ["Question: Which is the function of the gallbladder?\nAnswer:", " produce digestive enzymes"], ["Question: Which type of adaptation allows an animal to deceive its predator?\nAnswer:", " large size"], ["Question: Which type of adaptation allows an animal to deceive its predator?\nAnswer:", " protective coloration"], ["Question: Which type of adaptation allows an animal to deceive its predator?\nAnswer:", " scent glands"], ["Question: Which type of adaptation allows an animal to deceive its predator?\nAnswer:", " leathery skin"], ["Question: Which three things do animals need from their environment in order to survive?\nAnswer:", " soil, water, and food"], ["Question: Which three things do animals need from their environment in order to survive?\nAnswer:", " soil, light, and water"], ["Question: Which three things do animals need from their environment in order to survive?\nAnswer:", " air, food, and water"], ["Question: Which three things do animals need from their environment in order to survive?\nAnswer:", " air, water, and light"], ["Question: When atmospheric carbon dioxide increases, some of the carbon dioxide dissolves in the ocean causing the ocean to become\nAnswer:", " warmer."], ["Question: When atmospheric carbon dioxide increases, some of the carbon dioxide dissolves in the ocean causing the ocean to become\nAnswer:", " cooler."], ["Question: When atmospheric carbon dioxide increases, some of the carbon dioxide dissolves in the ocean causing the ocean to become\nAnswer:", " more acidic."], ["Question: When atmospheric carbon dioxide increases, some of the carbon dioxide dissolves in the ocean causing the ocean to become\nAnswer:", " more alkaline."], ["Question: Which is the most important safety measure to follow when using an acid in a classroom laboratory?\nAnswer:", " wearing protective clothing and goggles"], ["Question: Which is the most important safety measure to follow when using an acid in a classroom laboratory?\nAnswer:", " keeping the window open"], ["Question: Which is the most important safety measure to follow when using an acid in a classroom laboratory?\nAnswer:", " closing the door to the hall"], ["Question: Which is the most important safety measure to follow when using an acid in a classroom laboratory?\nAnswer:", " using bright fluorescent lights"], ["Question: Which is an effect that cities have on the weather?\nAnswer:", " Small numbers of plants cause rain to fall more often."], ["Question: Which is an effect that cities have on the weather?\nAnswer:", " Large numbers of houses cause the wind to be stronger."], ["Question: Which is an effect that cities have on the weather?\nAnswer:", " Small areas of open water cause fog to be more common."], ["Question: Which is an effect that cities have on the weather?\nAnswer:", " Large areas of pavement cause the temperature to be hotter."], ["Question: Which two terms are used to describe weather?\nAnswer:", " wind direction and amount of erosion"], ["Question: Which two terms are used to describe weather?\nAnswer:", " gravity and amount of rain"], ["Question: Which two terms are used to describe weather?\nAnswer:", " groundwater and cloud cover"], ["Question: Which two terms are used to describe weather?\nAnswer:", " air temperature and wind speed"], ["Question: A population of tree-climbing lizard lives on one bank of a large river. The other bank of the river is a treeless prairie. During a flood, 40 lizards were transferred to the prairie side of the river. After 200 generations, this transferred population of lizard lost the ability to climb.Which mechanism is most likely responsible for this loss of function within the transferred population?\nAnswer:", " gene flow"], ["Question: A population of tree-climbing lizard lives on one bank of a large river. The other bank of the river is a treeless prairie. During a flood, 40 lizards were transferred to the prairie side of the river. After 200 generations, this transferred population of lizard lost the ability to climb.Which mechanism is most likely responsible for this loss of function within the transferred population?\nAnswer:", " natural selection"], ["Question: A population of tree-climbing lizard lives on one bank of a large river. The other bank of the river is a treeless prairie. During a flood, 40 lizards were transferred to the prairie side of the river. After 200 generations, this transferred population of lizard lost the ability to climb.Which mechanism is most likely responsible for this loss of function within the transferred population?\nAnswer:", " genetic drift"], ["Question: A population of tree-climbing lizard lives on one bank of a large river. The other bank of the river is a treeless prairie. During a flood, 40 lizards were transferred to the prairie side of the river. After 200 generations, this transferred population of lizard lost the ability to climb.Which mechanism is most likely responsible for this loss of function within the transferred population?\nAnswer:", " mutation"], ["Question: In plants, what is responsible for passing traits from one generation to the next?\nAnswer:", " chloroplasts"], ["Question: In plants, what is responsible for passing traits from one generation to the next?\nAnswer:", " photosynthesis"], ["Question: In plants, what is responsible for passing traits from one generation to the next?\nAnswer:", " roots"], ["Question: In plants, what is responsible for passing traits from one generation to the next?\nAnswer:", " genes"], ["Question: In which way is a prokaryotic cell different from a eukaryotic cell?\nAnswer:", " A prokaryotic cell is larger."], ["Question: In which way is a prokaryotic cell different from a eukaryotic cell?\nAnswer:", " A prokaryotic cell has no nucleus."], ["Question: In which way is a prokaryotic cell different from a eukaryotic cell?\nAnswer:", " A prokaryotic cell can reproduce itself."], ["Question: In which way is a prokaryotic cell different from a eukaryotic cell?\nAnswer:", " A prokaryotic cell has a cell membrane."]]
\ No newline at end of file
{"results": {"arc_easy": {"acc": 0.1, "acc_stderr": 0.09999999999999999, "acc_norm": 0.2, "acc_norm_stderr": 0.13333333333333333}}, "versions": {"arc_easy": 0}}
\ No newline at end of file
{"results": {"arc_easy": {"acc": 0.2474747474747475, "acc_norm": 0.24074074074074073, "acc_norm_stderr": 0.008772796145221907, "acc_stderr": 0.008855114414834707}}, "versions": {"arc_easy": 0}}
\ No newline at end of file
04c3a63a6b3c579bd3775d92b3076ba9130041d5ce7cf9244d3f86e95c804387
\ No newline at end of file
[["Question: What is (1 * 7) * 8?\nAnswer:", " 56"], ["Question: What is (2 - 6) * 3?\nAnswer:", " -12"], ["Question: What is (6 - 1) * 4?\nAnswer:", " 20"], ["Question: What is (8 + 4) * 9?\nAnswer:", " 108"], ["Question: What is (3 * 5) - 5?\nAnswer:", " 10"], ["Question: What is (8 * 5) * 8?\nAnswer:", " 320"], ["Question: What is (7 - 1) + 4?\nAnswer:", " 10"], ["Question: What is (1 - 9) * 1?\nAnswer:", " -8"], ["Question: What is (3 + 4) * 8?\nAnswer:", " 56"], ["Question: What is (8 - 3) - 3?\nAnswer:", " 2"]]
\ No newline at end of file
6ca1ca6ebd7cac4420d5005f7f35b0edbc921377f5e4f8874cc176e4fb6d79d4
\ No newline at end of file
[["Question: What is 56 plus 58?\nAnswer:", " 114"], ["Question: What is 43 plus 40?\nAnswer:", " 83"], ["Question: What is 4 plus 80?\nAnswer:", " 84"], ["Question: What is 35 plus 64?\nAnswer:", " 99"], ["Question: What is 3 plus 28?\nAnswer:", " 31"], ["Question: What is 37 plus 72?\nAnswer:", " 109"], ["Question: What is 7 plus 45?\nAnswer:", " 52"], ["Question: What is 6 plus 50?\nAnswer:", " 56"], ["Question: What is 17 plus 48?\nAnswer:", " 65"], ["Question: What is 87 plus 44?\nAnswer:", " 131"]]
\ No newline at end of file
14ac5e510cdf82967d6827a9ca059906ee1db2e347be1b17f36403a157e73552
\ No newline at end of file
[["Question: What is 22 times 26?\nAnswer:", " 572"], ["Question: What is 33 times 6?\nAnswer:", " 198"], ["Question: What is 83 times 55?\nAnswer:", " 4565"], ["Question: What is 21 times 93?\nAnswer:", " 1953"], ["Question: What is 22 times 82?\nAnswer:", " 1804"], ["Question: What is 14 times 88?\nAnswer:", " 1232"], ["Question: What is 96 times 57?\nAnswer:", " 5472"], ["Question: What is 85 times 33?\nAnswer:", " 2805"], ["Question: What is 84 times 42?\nAnswer:", " 3528"], ["Question: What is 10 times 30?\nAnswer:", " 300"]]
\ No newline at end of file
66f7ff3b40251ee38fadcbee658e309a200224356fc3efa07d0a490a2c24bfa3
\ No newline at end of file
[["Question: What is 59 minus 38?\nAnswer:", " 21"], ["Question: What is 97 minus 93?\nAnswer:", " 4"], ["Question: What is 91 minus 80?\nAnswer:", " 11"], ["Question: What is 91 minus 79?\nAnswer:", " 12"], ["Question: What is 11 minus 99?\nAnswer:", " -88"], ["Question: What is 43 minus 52?\nAnswer:", " -9"], ["Question: What is 20 minus 2?\nAnswer:", " 18"], ["Question: What is 57 minus 72?\nAnswer:", " -15"], ["Question: What is 99 minus 65?\nAnswer:", " 34"], ["Question: What is 91 minus 76?\nAnswer:", " 15"]]
\ No newline at end of file
c421f9cd5a5001b80e528441da925128177a04db8526ebcdab543a90b33c9ce2
\ No newline at end of file
[["Question: What is 954 plus 622?\nAnswer:", " 1576"], ["Question: What is 399 plus 437?\nAnswer:", " 836"], ["Question: What is 449 plus 252?\nAnswer:", " 701"], ["Question: What is 486 plus 783?\nAnswer:", " 1269"], ["Question: What is 60 plus 470?\nAnswer:", " 530"], ["Question: What is 99 plus 891?\nAnswer:", " 990"], ["Question: What is 973 plus 333?\nAnswer:", " 1306"], ["Question: What is 160 plus 41?\nAnswer:", " 201"], ["Question: What is 613 plus 759?\nAnswer:", " 1372"], ["Question: What is 596 plus 756?\nAnswer:", " 1352"]]
\ No newline at end of file
d3d8bad8827d4530945a1d8b3c7589c0235bbed0bc89e7561a6fdac678f6ce5c
\ No newline at end of file
[["Question: What is 230 minus 601?\nAnswer:", " -371"], ["Question: What is 523 minus 347?\nAnswer:", " 176"], ["Question: What is 48 minus 614?\nAnswer:", " -566"], ["Question: What is 681 minus 512?\nAnswer:", " 169"], ["Question: What is 831 minus 352?\nAnswer:", " 479"], ["Question: What is 582 minus 75?\nAnswer:", " 507"], ["Question: What is 592 minus 53?\nAnswer:", " 539"], ["Question: What is 466 minus 94?\nAnswer:", " 372"], ["Question: What is 950 minus 567?\nAnswer:", " 383"], ["Question: What is 331 minus 962?\nAnswer:", " -631"]]
\ No newline at end of file
d3557beb8b9e5704122c2fc6362b11fbe2c3f2f3cb72aed4462b208767c40e01
\ No newline at end of file
[["Question: What is 2762 plus 2751?\nAnswer:", " 5513"], ["Question: What is 8392 plus 7368?\nAnswer:", " 15760"], ["Question: What is 8498 plus 6157?\nAnswer:", " 14655"], ["Question: What is 602 plus 8021?\nAnswer:", " 8623"], ["Question: What is 8132 plus 372?\nAnswer:", " 8504"], ["Question: What is 9195 plus 3429?\nAnswer:", " 12624"], ["Question: What is 9101 plus 8513?\nAnswer:", " 17614"], ["Question: What is 516 plus 9035?\nAnswer:", " 9551"], ["Question: What is 6392 plus 3981?\nAnswer:", " 10373"], ["Question: What is 2322 plus 6178?\nAnswer:", " 8500"]]
\ No newline at end of file
d915830b8621e66331383bb2ae4c60acebf008e2f94741092ef4c33ea5441037
\ No newline at end of file
[["Question: What is 23 minus 2391?\nAnswer:", " -2368"], ["Question: What is 6709 minus 1820?\nAnswer:", " 4889"], ["Question: What is 8861 minus 1565?\nAnswer:", " 7296"], ["Question: What is 4648 minus 8066?\nAnswer:", " -3418"], ["Question: What is 6143 minus 1930?\nAnswer:", " 4213"], ["Question: What is 3754 minus 8779?\nAnswer:", " -5025"], ["Question: What is 5702 minus 981?\nAnswer:", " 4721"], ["Question: What is 174 minus 6491?\nAnswer:", " -6317"], ["Question: What is 35 minus 1334?\nAnswer:", " -1299"], ["Question: What is 5987 minus 6118?\nAnswer:", " -131"]]
\ No newline at end of file
49edb1e735660631ea6cc309721e6c0b80b7106a613a6959514852ca48f1130e
\ No newline at end of file
[["Question: What is 55797 plus 20732?\nAnswer:", " 76529"], ["Question: What is 33390 plus 3400?\nAnswer:", " 36790"], ["Question: What is 50700 plus 38532?\nAnswer:", " 89232"], ["Question: What is 45591 plus 34257?\nAnswer:", " 79848"], ["Question: What is 83611 plus 73492?\nAnswer:", " 157103"], ["Question: What is 77051 plus 293?\nAnswer:", " 77344"], ["Question: What is 53983 plus 52106?\nAnswer:", " 106089"], ["Question: What is 86834 plus 52695?\nAnswer:", " 139529"], ["Question: What is 70252 plus 9288?\nAnswer:", " 79540"], ["Question: What is 62978 plus 64064?\nAnswer:", " 127042"]]
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment