Commit f9cc0267 authored by Leo Gao's avatar Leo Gao
Browse files

Use hashed version stability test instead

parent 10d4b64a
2888d6d098a5ef8c1e7f0d8295ba80826e2e04e431f57508dfb71d53e1cd4604
\ No newline at end of file
[["Question: What is 45809 minus 41446?\nAnswer:", " 4363"], ["Question: What is 16424 minus 79811?\nAnswer:", " -63387"], ["Question: What is 76283 minus 1280?\nAnswer:", " 75003"], ["Question: What is 95869 minus 98912?\nAnswer:", " -3043"], ["Question: What is 33996 minus 38309?\nAnswer:", " -4313"], ["Question: What is 33699 minus 68525?\nAnswer:", " -34826"], ["Question: What is 89794 minus 83303?\nAnswer:", " 6491"], ["Question: What is 30221 minus 53512?\nAnswer:", " -23291"], ["Question: What is 50862 minus 28796?\nAnswer:", " 22066"], ["Question: What is 94282 minus 25820?\nAnswer:", " 68462"]]
\ No newline at end of file
de5aa6f77a2e0fd050b9c272f10c4d5d5581e4f75ffa60926f79e60ae1738960
\ No newline at end of file
[["NCIS: New Orleans (season 4) -- The fourth season of NCIS: New Orleans premiered on September 26, 2017 on CBS. The series continues to air following Bull, Tuesday at 10:00 p.m. (ET) and contained 24 episodes. The season concluded on May 15, 2018.\nQuestion: is ncis new orleans over for the season\nAnswer:", " yes"], ["NCIS: New Orleans (season 4) -- The fourth season of NCIS: New Orleans premiered on September 26, 2017 on CBS. The series continues to air following Bull, Tuesday at 10:00 p.m. (ET) and contained 24 episodes. The season concluded on May 15, 2018.\nQuestion: is ncis new orleans over for the season\nAnswer:", " no"], ["Facial hair in the military -- All branches of the U.S. Military currently prohibit beards for a vast majority of recruits, although some mustaches are still allowed, based on policies that were initiated during the period of World War I.\nQuestion: can i have a beard in the military\nAnswer:", " yes"], ["Facial hair in the military -- All branches of the U.S. Military currently prohibit beards for a vast majority of recruits, although some mustaches are still allowed, based on policies that were initiated during the period of World War I.\nQuestion: can i have a beard in the military\nAnswer:", " no"], ["Scrum (rugby) -- While the Laws of the Game continue to provide for competitive scrums, a convention exists that some scrum rules are not enforced. During the 1970s, scrum penalties for feeding the ball into the legs of the second row, packs moving off the ``mark'' or collapsing the scrum were seen as unattractive. The ability of teams to win a game purely on goals from scrum penalties was also seen as unfair. In an effort to improve this situation, changes to rules and their enforcement were made. The number of scrums was reduced with the introduction of the ``handover'' after a team has used a set of six tackles, the differential penalty, one which cannot be kicked at goal was brought in for offences at scrums and referees ceased enforcing some rules regarding feeding the ball into scrum. Aided by this change, it is common for professional teams not to fully contest scrums, according to their choice of tactics.\nQuestion: can you contest a scrum in rugby league\nAnswer:", " yes"], ["Scrum (rugby) -- While the Laws of the Game continue to provide for competitive scrums, a convention exists that some scrum rules are not enforced. During the 1970s, scrum penalties for feeding the ball into the legs of the second row, packs moving off the ``mark'' or collapsing the scrum were seen as unattractive. The ability of teams to win a game purely on goals from scrum penalties was also seen as unfair. In an effort to improve this situation, changes to rules and their enforcement were made. The number of scrums was reduced with the introduction of the ``handover'' after a team has used a set of six tackles, the differential penalty, one which cannot be kicked at goal was brought in for offences at scrums and referees ceased enforcing some rules regarding feeding the ball into scrum. Aided by this change, it is common for professional teams not to fully contest scrums, according to their choice of tactics.\nQuestion: can you contest a scrum in rugby league\nAnswer:", " no"], ["Now You See Me (film series) -- Now You See Me is a series of heist thriller films written by Ed Solomon, Boaz Yakin, and Edward Ricourt. They focus on the actions of a team of illusionists named ``The Four Horsemen'' who pull off near impossible heists. The series features an ensemble cast including Jesse Eisenberg, Mark Ruffalo, Woody Harrelson, Isla Fisher, Dave Franco, Michael Caine, Lizzy Caplan, and Morgan Freeman. The first film was released in 2013, while the second was released in 2016, and a third film is currently in development and set to be released in 2019. The series has received mixed reviews from critics and audiences and grossed nearly $700 million worldwide.\nQuestion: will there be another now you see me movie\nAnswer:", " yes"], ["Now You See Me (film series) -- Now You See Me is a series of heist thriller films written by Ed Solomon, Boaz Yakin, and Edward Ricourt. They focus on the actions of a team of illusionists named ``The Four Horsemen'' who pull off near impossible heists. The series features an ensemble cast including Jesse Eisenberg, Mark Ruffalo, Woody Harrelson, Isla Fisher, Dave Franco, Michael Caine, Lizzy Caplan, and Morgan Freeman. The first film was released in 2013, while the second was released in 2016, and a third film is currently in development and set to be released in 2019. The series has received mixed reviews from critics and audiences and grossed nearly $700 million worldwide.\nQuestion: will there be another now you see me movie\nAnswer:", " no"], ["Acute and obtuse triangles -- An acute triangle is a triangle with all three angles acute (less than 90\u00b0). An obtuse triangle is one with one obtuse angle (greater than 90\u00b0) and two acute angles. Since a triangle's angles must sum to 180\u00b0, no triangle can have more than one obtuse angle.\nQuestion: is it possible to have a triangle with two obtuse angles\nAnswer:", " yes"], ["Acute and obtuse triangles -- An acute triangle is a triangle with all three angles acute (less than 90\u00b0). An obtuse triangle is one with one obtuse angle (greater than 90\u00b0) and two acute angles. Since a triangle's angles must sum to 180\u00b0, no triangle can have more than one obtuse angle.\nQuestion: is it possible to have a triangle with two obtuse angles\nAnswer:", " no"], ["St George's Chapel, Windsor Castle -- St George's Chapel at Windsor Castle in England, is a chapel designed in the high-medieval Gothic style. It is both a Royal Peculiar, a church under the direct jurisdiction of the monarch, and the Chapel of the Order of the Garter. Seating approximately 800, it is located in the Lower Ward of the castle.\nQuestion: is st george's chapel in westminster abbey\nAnswer:", " yes"], ["St George's Chapel, Windsor Castle -- St George's Chapel at Windsor Castle in England, is a chapel designed in the high-medieval Gothic style. It is both a Royal Peculiar, a church under the direct jurisdiction of the monarch, and the Chapel of the Order of the Garter. Seating approximately 800, it is located in the Lower Ward of the castle.\nQuestion: is st george's chapel in westminster abbey\nAnswer:", " no"], ["San Juan, Puerto Rico -- San Juan, as a settlement of the Spanish Empire, was used by merchant and military ships traveling from Spain as the first stopover in the Americas. Because of its prominence in the Caribbean, a network of fortifications was built to protect the transports of gold and silver from the New World to Europe. Because of the rich cargoes, San Juan became a target of the foreign powers of the time.\nQuestion: is san juan puerto rico in the caribbean\nAnswer:", " yes"], ["San Juan, Puerto Rico -- San Juan, as a settlement of the Spanish Empire, was used by merchant and military ships traveling from Spain as the first stopover in the Americas. Because of its prominence in the Caribbean, a network of fortifications was built to protect the transports of gold and silver from the New World to Europe. Because of the rich cargoes, San Juan became a target of the foreign powers of the time.\nQuestion: is san juan puerto rico in the caribbean\nAnswer:", " no"], ["Toyota Highlander -- Announced in April 2000 at the New York Auto Show and arriving in late 2000 in Japan and January 2001 in North America, the Highlander became one of the first car-based mid-size SUV or mid-size crossovers. The Highlander is the crossover counterpart to the more rugged, truck-based midsize 4Runner and became Toyota's best-selling SUV before being surpassed by the smaller RAV4 in 2006. In Japan, the Kluger is exclusive to dealership network called Toyota NETZ as a larger alternative to the RAV4.\nQuestion: is the toyota highlander on a truck frame\nAnswer:", " yes"], ["Toyota Highlander -- Announced in April 2000 at the New York Auto Show and arriving in late 2000 in Japan and January 2001 in North America, the Highlander became one of the first car-based mid-size SUV or mid-size crossovers. The Highlander is the crossover counterpart to the more rugged, truck-based midsize 4Runner and became Toyota's best-selling SUV before being surpassed by the smaller RAV4 in 2006. In Japan, the Kluger is exclusive to dealership network called Toyota NETZ as a larger alternative to the RAV4.\nQuestion: is the toyota highlander on a truck frame\nAnswer:", " no"], ["School integration in the United States -- Some schools around America were integrated before the mid-20th century, the first ever school being Lowell High School in Massachusetts, which has accepted students of all races at its inception. The earliest known African American student, Caroline Van Vronker, attended the school in 1843. The integration of all American schools was a major catalyst for the civil rights action and racial violence that occurred in the United States during the latter half of the 20th century.\nQuestion: was integration the rule in the northern states\nAnswer:", " yes"], ["School integration in the United States -- Some schools around America were integrated before the mid-20th century, the first ever school being Lowell High School in Massachusetts, which has accepted students of all races at its inception. The earliest known African American student, Caroline Van Vronker, attended the school in 1843. The integration of all American schools was a major catalyst for the civil rights action and racial violence that occurred in the United States during the latter half of the 20th century.\nQuestion: was integration the rule in the northern states\nAnswer:", " no"], ["Rhombus -- Every rhombus is a parallelogram and a kite. A rhombus with right angles is a square.\nQuestion: do all rhombuses have 2 pairs of parallel sides\nAnswer:", " yes"], ["Rhombus -- Every rhombus is a parallelogram and a kite. A rhombus with right angles is a square.\nQuestion: do all rhombuses have 2 pairs of parallel sides\nAnswer:", " no"]]
\ No newline at end of file
{"results": {"boolq": {"acc": 0.4, "acc_stderr": 0.16329931618554522}}, "versions": {"boolq": 0}}
\ No newline at end of file
{"results": {"boolq": {"acc": 0.5048929663608562, "acc_stderr": 0.00874463623355505}}, "versions": {"boolq": 0}}
\ No newline at end of file
ec3b1bbb9561e39c43c6f77a23b4060b15c606141c5346e3d0791b3e92aaa5d0
\ No newline at end of file
[["Then they would awake, terrified and sweating, to find themselves in white starched linen, in a comfortable bed, in peaceful England. And all would be well. It may be said that although he survived it the siege nevertheless had a bad effect on the Collector.\nQuestion: the siege nevertheless had a bad effect on the Collector. True, False or Neither?\nAnswer:", " True"], ["Then they would awake, terrified and sweating, to find themselves in white starched linen, in a comfortable bed, in peaceful England. And all would be well. It may be said that although he survived it the siege nevertheless had a bad effect on the Collector.\nQuestion: the siege nevertheless had a bad effect on the Collector. True, False or Neither?\nAnswer:", " Neither"], ["Then they would awake, terrified and sweating, to find themselves in white starched linen, in a comfortable bed, in peaceful England. And all would be well. It may be said that although he survived it the siege nevertheless had a bad effect on the Collector.\nQuestion: the siege nevertheless had a bad effect on the Collector. True, False or Neither?\nAnswer:", " False"], ["A: I've never heard that one, that's very nice. Oh, so I'm all for the metric system and converting over and I think, I guess, my feeling is the way to do it is to just start giving weights, you know, have a very brief transition period and then just start giving weights and kilometers, er, just as in kilometers and weights and kilograms and everything like that and, uh, just have people start using it rather than having people constantly trying to convert. Remember me getting a package of something that said one pound, this is a package of dates mind you, was, presumably something you weigh fairly precisely, it said one pound and then in parenthesis it said four hundred fifty-four point six grams. B: Right, right. A: And, as near as I could tell, seeing that was basically anti-metric propaganda cause anyone who would say, well look I can either buy a pound of something at four hundred sixty-four point six grams which, of course, they couldn't weigh it out accurately anyway, um, every time I see something like that I think, well, that's an anti-metric argument. B: Yeah. Well, uh, I don't think it could ever happen with a quick transition.\nQuestion: it could happen with a quick transition. True, False or Neither?\nAnswer:", " True"], ["A: I've never heard that one, that's very nice. Oh, so I'm all for the metric system and converting over and I think, I guess, my feeling is the way to do it is to just start giving weights, you know, have a very brief transition period and then just start giving weights and kilometers, er, just as in kilometers and weights and kilograms and everything like that and, uh, just have people start using it rather than having people constantly trying to convert. Remember me getting a package of something that said one pound, this is a package of dates mind you, was, presumably something you weigh fairly precisely, it said one pound and then in parenthesis it said four hundred fifty-four point six grams. B: Right, right. A: And, as near as I could tell, seeing that was basically anti-metric propaganda cause anyone who would say, well look I can either buy a pound of something at four hundred sixty-four point six grams which, of course, they couldn't weigh it out accurately anyway, um, every time I see something like that I think, well, that's an anti-metric argument. B: Yeah. Well, uh, I don't think it could ever happen with a quick transition.\nQuestion: it could happen with a quick transition. True, False or Neither?\nAnswer:", " Neither"], ["A: I've never heard that one, that's very nice. Oh, so I'm all for the metric system and converting over and I think, I guess, my feeling is the way to do it is to just start giving weights, you know, have a very brief transition period and then just start giving weights and kilometers, er, just as in kilometers and weights and kilograms and everything like that and, uh, just have people start using it rather than having people constantly trying to convert. Remember me getting a package of something that said one pound, this is a package of dates mind you, was, presumably something you weigh fairly precisely, it said one pound and then in parenthesis it said four hundred fifty-four point six grams. B: Right, right. A: And, as near as I could tell, seeing that was basically anti-metric propaganda cause anyone who would say, well look I can either buy a pound of something at four hundred sixty-four point six grams which, of course, they couldn't weigh it out accurately anyway, um, every time I see something like that I think, well, that's an anti-metric argument. B: Yeah. Well, uh, I don't think it could ever happen with a quick transition.\nQuestion: it could happen with a quick transition. True, False or Neither?\nAnswer:", " False"], ["A: And you also get a lot of, uh, juries are extremely, uh, and from what I hear, I have some friends who do expert witness testimony and they say that, uh, juries are extremely vulnerable to, uh, sort of emotional pitches, you know, the prosecutor will want to, oh, I don't know show the mugging victim, you know, show the nice person he was and what a family life, and basically get the jury to be very sympathetic with the victim, or, uh, if it's a corporation, that was, uh, you know, harming some individual or something like that, they get very much, well, you know, it's just a big faceless corporation. let's make them pay as much as possible. Things like that. B: Uh-huh. A: So, not, I mean, I'm, the problem is I can't guarantee that a judge would necessarily be much better than a jury, but I'd be real nervous having a jury not at least fully agree on what the settlements would be, things like that. B: Ri-, I don't think the judge should just make the decision alone.\nQuestion: the judge should just make the decision alone. True, False or Neither?\nAnswer:", " True"], ["A: And you also get a lot of, uh, juries are extremely, uh, and from what I hear, I have some friends who do expert witness testimony and they say that, uh, juries are extremely vulnerable to, uh, sort of emotional pitches, you know, the prosecutor will want to, oh, I don't know show the mugging victim, you know, show the nice person he was and what a family life, and basically get the jury to be very sympathetic with the victim, or, uh, if it's a corporation, that was, uh, you know, harming some individual or something like that, they get very much, well, you know, it's just a big faceless corporation. let's make them pay as much as possible. Things like that. B: Uh-huh. A: So, not, I mean, I'm, the problem is I can't guarantee that a judge would necessarily be much better than a jury, but I'd be real nervous having a jury not at least fully agree on what the settlements would be, things like that. B: Ri-, I don't think the judge should just make the decision alone.\nQuestion: the judge should just make the decision alone. True, False or Neither?\nAnswer:", " Neither"], ["A: And you also get a lot of, uh, juries are extremely, uh, and from what I hear, I have some friends who do expert witness testimony and they say that, uh, juries are extremely vulnerable to, uh, sort of emotional pitches, you know, the prosecutor will want to, oh, I don't know show the mugging victim, you know, show the nice person he was and what a family life, and basically get the jury to be very sympathetic with the victim, or, uh, if it's a corporation, that was, uh, you know, harming some individual or something like that, they get very much, well, you know, it's just a big faceless corporation. let's make them pay as much as possible. Things like that. B: Uh-huh. A: So, not, I mean, I'm, the problem is I can't guarantee that a judge would necessarily be much better than a jury, but I'd be real nervous having a jury not at least fully agree on what the settlements would be, things like that. B: Ri-, I don't think the judge should just make the decision alone.\nQuestion: the judge should just make the decision alone. True, False or Neither?\nAnswer:", " False"], ["A: I'm like, I'll get a job some day and my boss will pay for it, I'll be needed. B: Yeah. A: Because, um, I didn't want to go do it myself because I didn't think I was really going to use it.\nQuestion: he was really going to use it. True, False or Neither?\nAnswer:", " True"], ["A: I'm like, I'll get a job some day and my boss will pay for it, I'll be needed. B: Yeah. A: Because, um, I didn't want to go do it myself because I didn't think I was really going to use it.\nQuestion: he was really going to use it. True, False or Neither?\nAnswer:", " Neither"], ["A: I'm like, I'll get a job some day and my boss will pay for it, I'll be needed. B: Yeah. A: Because, um, I didn't want to go do it myself because I didn't think I was really going to use it.\nQuestion: he was really going to use it. True, False or Neither?\nAnswer:", " False"], ["B: And other than that I do not think it should be allowable. I think it should be illegal for them to want to do that. it's kind of the big brother syndrome, I mean, I just, anything like that just kind of scares me. A: I tend to view it, even though I don't think I'd work for a company that did that, I sort of want to defend an employer's rights uh, in addition to an individual's rights,\nQuestion: she would work for a company that did that. True, False or Neither?\nAnswer:", " True"], ["B: And other than that I do not think it should be allowable. I think it should be illegal for them to want to do that. it's kind of the big brother syndrome, I mean, I just, anything like that just kind of scares me. A: I tend to view it, even though I don't think I'd work for a company that did that, I sort of want to defend an employer's rights uh, in addition to an individual's rights,\nQuestion: she would work for a company that did that. True, False or Neither?\nAnswer:", " Neither"], ["B: And other than that I do not think it should be allowable. I think it should be illegal for them to want to do that. it's kind of the big brother syndrome, I mean, I just, anything like that just kind of scares me. A: I tend to view it, even though I don't think I'd work for a company that did that, I sort of want to defend an employer's rights uh, in addition to an individual's rights,\nQuestion: she would work for a company that did that. True, False or Neither?\nAnswer:", " False"], ["The other set being in the pocket of Giovanna's overall from which she now drew them and held them up making it clear that they would be relinquished only upon her death and then only into the hands of Signor Kettering. What had occurred was quite contrary to the wishes of the padrone who would be outraged if he ever got to hear of it. Despite this disastrous beginning however Giovanna would be there in the morning her own family circumstances permitting and she would be much obliged if the Signora would make sure that her children were up and dressed and the breakfast eaten so that she could see that the house was returned to something like the order which Signor Kettering expected of it.\nQuestion: the house was returned to something like the order which Signor Kettering expected of it. True, False or Neither?\nAnswer:", " True"], ["The other set being in the pocket of Giovanna's overall from which she now drew them and held them up making it clear that they would be relinquished only upon her death and then only into the hands of Signor Kettering. What had occurred was quite contrary to the wishes of the padrone who would be outraged if he ever got to hear of it. Despite this disastrous beginning however Giovanna would be there in the morning her own family circumstances permitting and she would be much obliged if the Signora would make sure that her children were up and dressed and the breakfast eaten so that she could see that the house was returned to something like the order which Signor Kettering expected of it.\nQuestion: the house was returned to something like the order which Signor Kettering expected of it. True, False or Neither?\nAnswer:", " Neither"], ["The other set being in the pocket of Giovanna's overall from which she now drew them and held them up making it clear that they would be relinquished only upon her death and then only into the hands of Signor Kettering. What had occurred was quite contrary to the wishes of the padrone who would be outraged if he ever got to hear of it. Despite this disastrous beginning however Giovanna would be there in the morning her own family circumstances permitting and she would be much obliged if the Signora would make sure that her children were up and dressed and the breakfast eaten so that she could see that the house was returned to something like the order which Signor Kettering expected of it.\nQuestion: the house was returned to something like the order which Signor Kettering expected of it. True, False or Neither?\nAnswer:", " False"], ["B: and, you know, they just love kittens. A: Yeah. B: They just are fascinated. A: Oh, yeah. B: So she doesn't know that this is a cat yet.\nQuestion: this is a cat. True, False or Neither?\nAnswer:", " True"], ["B: and, you know, they just love kittens. A: Yeah. B: They just are fascinated. A: Oh, yeah. B: So she doesn't know that this is a cat yet.\nQuestion: this is a cat. True, False or Neither?\nAnswer:", " Neither"], ["B: and, you know, they just love kittens. A: Yeah. B: They just are fascinated. A: Oh, yeah. B: So she doesn't know that this is a cat yet.\nQuestion: this is a cat. True, False or Neither?\nAnswer:", " False"], ["'Very well, I'll go. But I pick my own men, and if we ever have to fight, you obey my word.'' Jehan did not think that Sidacai was in any position to impose conditions but he sat back in his chair considering.\nQuestion: Sidacai was in a position to impose conditions. True, False or Neither?\nAnswer:", " True"], ["'Very well, I'll go. But I pick my own men, and if we ever have to fight, you obey my word.'' Jehan did not think that Sidacai was in any position to impose conditions but he sat back in his chair considering.\nQuestion: Sidacai was in a position to impose conditions. True, False or Neither?\nAnswer:", " Neither"], ["'Very well, I'll go. But I pick my own men, and if we ever have to fight, you obey my word.'' Jehan did not think that Sidacai was in any position to impose conditions but he sat back in his chair considering.\nQuestion: Sidacai was in a position to impose conditions. True, False or Neither?\nAnswer:", " False"], ["B: If, uh, you've some kid uh, who's from a broken family, the schools are supposed to fill that void. It's gotten way beyond uh, you know, teaching classes and maybe providing extracurricular sports activities or something like, oh, were kind of traditionally the school's roles. A: Yeah. Yeah, it's interesting because, uh, we're just having conversation on this, uh, with a couple of people yesterday. And I was expressing my frustrations that, uh, so many problems, I work in a high school, are that kids don't have a degree of self-discipline which may be reflected in society at large. Uh, and you can't expect in a classroom for a particular course an hour a day to counteract, uh, sixteen or seventeen years of influence at home. B: Right. A: Um, and, it's seen more so because when you call parents up, many parents won't even recognize that there is a problem\nQuestion: there is a problem. True, False or Neither?\nAnswer:", " True"], ["B: If, uh, you've some kid uh, who's from a broken family, the schools are supposed to fill that void. It's gotten way beyond uh, you know, teaching classes and maybe providing extracurricular sports activities or something like, oh, were kind of traditionally the school's roles. A: Yeah. Yeah, it's interesting because, uh, we're just having conversation on this, uh, with a couple of people yesterday. And I was expressing my frustrations that, uh, so many problems, I work in a high school, are that kids don't have a degree of self-discipline which may be reflected in society at large. Uh, and you can't expect in a classroom for a particular course an hour a day to counteract, uh, sixteen or seventeen years of influence at home. B: Right. A: Um, and, it's seen more so because when you call parents up, many parents won't even recognize that there is a problem\nQuestion: there is a problem. True, False or Neither?\nAnswer:", " Neither"], ["B: If, uh, you've some kid uh, who's from a broken family, the schools are supposed to fill that void. It's gotten way beyond uh, you know, teaching classes and maybe providing extracurricular sports activities or something like, oh, were kind of traditionally the school's roles. A: Yeah. Yeah, it's interesting because, uh, we're just having conversation on this, uh, with a couple of people yesterday. And I was expressing my frustrations that, uh, so many problems, I work in a high school, are that kids don't have a degree of self-discipline which may be reflected in society at large. Uh, and you can't expect in a classroom for a particular course an hour a day to counteract, uh, sixteen or seventeen years of influence at home. B: Right. A: Um, and, it's seen more so because when you call parents up, many parents won't even recognize that there is a problem\nQuestion: there is a problem. True, False or Neither?\nAnswer:", " False"], ["During that pause I realized that Mala had not been offered a seat, nor any food or drink. The Emissary and his people were behaving as if she simply wasn't there. I could see that she was scowling and stiffening into a Mark 2 temper so I gave her an encouraging smile - which raised her as I expected to a Mark 3.\nQuestion: Mala was scowling and stiffening into a Mark 2 temper. True, False or Neither?\nAnswer:", " True"], ["During that pause I realized that Mala had not been offered a seat, nor any food or drink. The Emissary and his people were behaving as if she simply wasn't there. I could see that she was scowling and stiffening into a Mark 2 temper so I gave her an encouraging smile - which raised her as I expected to a Mark 3.\nQuestion: Mala was scowling and stiffening into a Mark 2 temper. True, False or Neither?\nAnswer:", " Neither"], ["During that pause I realized that Mala had not been offered a seat, nor any food or drink. The Emissary and his people were behaving as if she simply wasn't there. I could see that she was scowling and stiffening into a Mark 2 temper so I gave her an encouraging smile - which raised her as I expected to a Mark 3.\nQuestion: Mala was scowling and stiffening into a Mark 2 temper. True, False or Neither?\nAnswer:", " False"]]
\ No newline at end of file
{"results": {"cb": {"acc": 0.2, "acc_stderr": 0.13333333333333333, "f1": 0.14814814814814817}}, "versions": {"cb": 0}}
\ No newline at end of file
{"results": {"cb": {"acc": 0.3392857142857143, "acc_stderr": 0.06384226561930825, "f1": 0.2819143819143819}}, "versions": {"cb": 0}}
\ No newline at end of file
e8635578ed8ee70b707a666d35e468b9321db24470f80c92080651e2bfa01751
\ No newline at end of file
[["The more you would want, the less you would eat.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["The more you would want, the less you would eat.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["John was spoke by Mary to.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["John was spoke by Mary to.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["Paperback books lift onto the table easily.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["Paperback books lift onto the table easily.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["She mailed John a letter, but I don't know to whom.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["She mailed John a letter, but I don't know to whom.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["He shouted again, but I don't know who to.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["He shouted again, but I don't know who to.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["Tom will smoke the grass, and Reuben has the hash.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["Tom will smoke the grass, and Reuben has the hash.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["I think Agnes said that Bill would speak, but I don't remember what about.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["I think Agnes said that Bill would speak, but I don't remember what about.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["It is obvious that Pat is lying.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["It is obvious that Pat is lying.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["I presented Bill with it to read.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["I presented Bill with it to read.\nQuestion: Does this sentence make sense?\nAnswer:", " no"], ["Harry told Sue that Albania is a lovely place for a vacation, and Tom told Sally that Albania is a lovely place for a vacation.\nQuestion: Does this sentence make sense?\nAnswer:", " yes"], ["Harry told Sue that Albania is a lovely place for a vacation, and Tom told Sally that Albania is a lovely place for a vacation.\nQuestion: Does this sentence make sense?\nAnswer:", " no"]]
\ No newline at end of file
{"results": {"cola": {"mcc": -0.0890870806374748, "mcc_stderr": 0.22159098140155062}}, "versions": {"cola": 0}}
\ No newline at end of file
{"results": {"cola": {"mcc": -0.04538802810223175, "mcc_stderr": 0.023100371589225246}}, "versions": {"cola": 0}}
\ No newline at end of file
66276b9045b5300cba4b81340db06f674f031fa0b8883714ad0d03be464cd799
\ No newline at end of file
[["The pair of students came under scrutiny by the teacher because", " the students both received excellent grades."], ["The pair of students came under scrutiny by the teacher because", " their responses on the assignment were identical."], ["I twisted the cap off the soda bottle therefore", " the soda fizzed."], ["I twisted the cap off the soda bottle therefore", " the soda leaked out."], ["I spent the day at the pool therefore", " i sprained my ankle."], ["I spent the day at the pool therefore", " my face got sunburned."], ["The man drank heavily at the party therefore", " he had a headache the next day."], ["The man drank heavily at the party therefore", " he had a runny nose the next day."], ["The man perceived that the woman looked different because", " the woman got her hair cut."], ["The man perceived that the woman looked different because", " the woman wore a bracelet."], ["My skin broke out into a rash because", " i brushed against poison ivy in my yard."], ["My skin broke out into a rash because", " i eradicated the poison ivy from my yard."], ["The girl found a bug in her cereal therefore", " she poured milk in the bowl."], ["The girl found a bug in her cereal therefore", " she lost her appetite."], ["The woman asked the man to leave because", " he insulted her."], ["The woman asked the man to leave because", " he thanked her."], ["The judge pounded the gavel because", " the courtroom broke into uproar."], ["The judge pounded the gavel because", " the jury announced its verdict."], ["I stayed up late therefore", " i had vivid dreams that night."], ["I stayed up late therefore", " i was tired in the morning."]]
\ No newline at end of file
{"results": {"copa": {"acc": 0.5, "acc_stderr": 0.16666666666666666}}, "versions": {"copa": 0}}
\ No newline at end of file
{"results": {"copa": {"acc": 0.48, "acc_stderr": 0.050211673156867795}}, "versions": {"copa": 0}}
\ No newline at end of file
4a8605d5deed0423ec095700251ed93325b45d320aca35d4ce1e94702094435e
\ No newline at end of file
[["Lin Xiao, 21, a student at Guangdong University, has a big family - her two parents, a younger brother and two younger sisters. Lin took her role as the \"big sister\" seriously. When her first sister was born, Lin took turns with her mom holding the baby late into the night. \"I almost did everything that was supposed to be a parent's job, but I felt proud of myself,\" she said. Not all of Lin's classmates shared her experiences because of the family planning policy , a law that was carried out in China about forty years ago. But the situation is about to change. A new policy made on October 29 said all couples can now have two children. The new policy is expected to help raise the population of China. Recently, China has been facing an aging population and labor shortages because of the low birth rate . The two-child policy may also be the gift for every only child. Researchers found that growing up with a brother or sister can have good influence on one's mental health. \"Brothers and sisters do matter in unique ways. They give kids something that parents don't.\" Laura Walker, a professor from Beijing University, told China Daily. She noted that having a brother or a sister protects teenagers against loneliness, fear and so on. Liu Fang, 20, from Shenzhen University, has a 2-year-younger sister. When her sister disagreed with parents over choosing a college major, she helped her to communicate with parents. \"If necessary, I would always have her back,\" said Liu. \"The best part of having a sister is that you have a partner, friend and supporter throughout your life.\" But children with brothers or sisters also have to learn to understand and look after each other, said Laura.\n\nQ: According to the new policy, how many children are now allowed?\n\nA: two\n\nQ: When was it enacted?\n\nA: October 29\n\nQ: How far back was the original policy?\n\nA: about 40 years ago\n\nQ: How many children were allowed then?\n\nA: one\n\nQ: How old is Lin Xiao?\n\nA: 21\n\nQ: What does she do?\n\nA: She's a student.\n\nQ: Where?\n\nA: at Guangdong University\n\nQ: Does she have a large family?\n\nA: yes\n\nQ: Who does it consist of?\n\nA: her parents, a brother and two sisters\n\nQ: Who's job did she do?\n\nA: her parent's\n\nQ: What problems are caused by the low birth rate?\n\nA: an aging population and labor shortages\n\nQ: What type of influence are siblings on mental health?\n\nA: good\n\nQ: What does Laura Walker do?\n\nA: She's a professor.\n\nQ: Where?\n\nA: at Beijing University\n\nQ: What news outlet quoted her?\n\nA: China Daily\n\nQ: What does a sibling provide protection from?\n\nA: loneliness, fear and so on\n\nQ: Who is the 20 year old girl?\n\nA: Liu Fang\n\nQ: Where does she go to school?\n\nA: Shenzhen University\n\nQ: How old is her sibling?\n\nA: two\n\nQ: Is it a girl or boy?\n\nA: a girl\n\nQ: What is the best thing about having a sister?\n\nA:", ["\n"]], ["For millions of years, sharks have been the kings of the oceans, the top of the food chain. But these days, the hunter has become the hunted, because of better methods from commercial fishermen who are looking for fins to make expensive soup sold mostly in Asia. Shark fins are far more valuable than shark meat, so fishermen cut the fins off live fish and throw the sharks overboard to maximize the catch they bring back. \n\nShark finning is illegal in the United States, but there're tournament sport fishermen, who target and kill the biggest ones they take from the sea. These tournaments, the prizes of which can reach $5,000 or more, attract large crowds of anglers but also draw protests from animal rights groups and environmentalists. \n\nThe competitors say they are enjoying a fun and legal sport, the impact on the overall shark population is very small, and most of the sharks caught are returned to the ocean. Dave Johnson, who is from Kennebunkport, Maine, said no one ever comes close to the limit set by the government of killing one shark per day during the three-month season. \n\n\"I enjoy watching these animals, but I also enjoy catching and releasing them, and very rarely killing them and eating them,\" he said. \"If I thought killing one shark was endangering the species and contributing to their decline I'd stop doing it tomorrow.\" \n\nThat is exactly what marine biologists like Luke Tipple want to happen. \"I believe that they should just stop it. In fact, we don't need to be targeting, in any way, any of these threatened populations,\" he said. Up to 73 million sharks are killed annually, and many species are at risk of extinction .\n\nQ: how many are killed annually?\n\nA: Up to 73 million\n\nQ: According to who?\n\nA: Luke Tipple\n\nQ: What is used in Asia?\n\nA: fins\n\nQ: For?\n\nA: soup\n\nQ: Who is Tipple?\n\nA: a marine biologist\n\nQ: What is the monetary prize in tournaments?\n\nA: $5,000 or more\n\nQ: Is the soup cheap?\n\nA: No\n\nQ: What do the sport fishermen do?\n\nA: target and kill the biggest ones\n\nQ: What is the government set limit?\n\nA: one shark per day\n\nQ: where?\n\nA: in the United States\n\nQ: who talks about the limit?\n\nA: Dave Johnson\n\nQ: where is he from?\n\nA: Kennebunkport, Maine\n\nQ: who is against the sport?\n\nA: animal rights groups and environmentalists.\n\nQ: who likes it?\n\nA: large crowds of anglers\n\nQ: does Dave eat them?\n\nA: Yes\n\nQ: what does he like doing?\n\nA: watching these animals, catching and releasing them\n\nQ: how often does he eat them?\n\nA: very rarely\n\nQ: what were they known as?\n\nA: anglers\n\nQ: what were sharks known as?\n\nA: the kings of the oceans\n\nQ: and what's the saying now?\n\nA:", ["\n"]], ["The Federal City of Bonn () is a city on the banks of the Rhine in the German state of North Rhine-Westphalia, with a population of over 300,000. About south-southeast of Cologne, Bonn is in the southernmost part of the Rhine-Ruhr region, Germany's largest metropolitan area, with over 11 million inhabitants. \n\nTogether with the capital Berlin, the city is the \"de facto\" joint seat of government of Germany. Bonn is the secondary seat of the President, the Chancellor, the Bundesrat and the primary seat of six federal government ministries and twenty federal authorities. The title of Federal City () reflects its important political status within Germany. \n\nFounded in the 1st century BC as a Roman settlement, Bonn is one of Germany's oldest cities. From 1597 to 1794, Bonn was the capital of the Electorate of Cologne, and residence of the Archbishops and Prince-electors of Cologne. Composer Ludwig van Beethoven was born in Bonn in 1770. From 1949 to 1990, Bonn was the provisional capital (\"temporary seat of the Federal institutions\") of West Germany, and Germany's present constitution, the Basic Law, was declared in the city in 1949. From 1990 to 1999, Bonn served as the seat of government \u2013 but no longer capital \u2013 of reunited Germany.\n\nQ: What has a population of over 300,000\n\nA: The Federal City of Bonn\n\nQ: Where is it located?\n\nA: on the banks of the Rhine\n\nQ: In what land zone?\n\nA: the German state of North Rhine-Westphalia\n\nQ: Is it in the northernmost zone?\n\nA: no\n\nQ: What is it, then?\n\nA: southernmost\n\nQ: Does it house 10 million people?\n\nA: no\n\nQ: How many?\n\nA: over 11 million\n\nQ: What is its most important city?\n\nA: Bonn is a city. Do you mean in Germany?\n\nQ: Is it involved in governing?\n\nA: yes\n\nQ: When was it originally created?\n\nA: in the 1st century\n\nQ: As what?\n\nA: as a Roman settlement\n\nQ: Is it a newer town?\n\nA: no\n\nQ: Was someone famous birthed there?\n\nA: Yes\n\nQ: Who?\n\nA: Ludwig van Beethoven\n\nQ: And when?\n\nA: in 1770\n\nQ: What happened in 1949?\n\nA: the Basic Law, was declared\n\nQ: And from 1990 to 1999?\n\nA: Bonn served as the seat of government, but not the capitol\n\nQ: What governing bodies is it the primary house of?\n\nA: primary seat of six federal government ministries\n\nQ: Does \"Federal City\" mean anything?\n\nA: reflects its important political status within Germany\n\nQ: Is a medium-sized metro?\n\nA:", ["\n"]], ["CHAPTER XI: Free. \n\nIt was late at night before Blois was reached, and having alighted at the Aigle d'Or they engaged a private room. \n\n\"Even the Duke of Chateaurouge will be satisfied,\" Ronald said, \"that his schemes have failed, and that no more can be done just at present. It will be a bitter blow to him when those scoundrels, on their return to Paris, report their utter failure, for he must have considered it impossible that we could escape from the toils he had laid for us. I only wish that we had clear evidence that he is the author of these attempts. If so, I would go straight with Marshal Saxe and lay an accusation against him before the king; but however certain we may feel about it, we have really nothing to connect him with the affair, and it would be madness to accuse a king's favourite unless one could prove absolutely the truth of what one says. However, I hope some day that I shall get even with him. It will not be my fault if I do not.\" \n\nThat night Ronald and his mother debated what would be the best way to proceed in the morning, and finally they agreed that Malcolm should present himself at the prison with the order of release, and that they should remain at the hotel, to which Malcolm should bring Colonel Leslie, after breaking to him the news that his wife and son were both awaiting him. The shock, in any case, of sudden liberty, would be a severe one, and the meeting with his attached comrade would act as a preparation for that with his wife. \n\nQ: What is the title of this chapter?\n\nA: Free\n\nQ: Which chapter is it?\n\nA: XI\n\nQ: Where did they go?\n\nA: Blois\n\nQ: Where did they stay?\n\nA: the Aigle d'Or\n\nQ: What did they get there?\n\nA: a private room\n\nQ: When did they arrive?\n\nA: late at night\n\nQ: Who is speaking in the beginning?\n\nA: Ronald\n\nQ: Who is he talking about?\n\nA: the Duke\n\nQ: Of where?\n\nA: Chateaurouge\n\nQ: Have his plans succeeded?\n\nA: no\n\nQ: Can they be fixed at this point?\n\nA: no\n\nQ: Where are they going back to?\n\nA: Paris\n\nQ: Do they have proof of what he did?\n\nA: no\n\nQ: Is the ruler most likely to believe them?\n\nA: no\n\nQ: Why not?\n\nA: he was the king's favourite\n\nQ: Does he want to let it go or get revenge?\n\nA: yes\n\nQ: Which one?\n\nA: He wants to get even with him\n\nQ: What did they do that evening?\n\nA: debated\n\nQ: Who did?\n\nA: Ronald and his mother\n\nQ: What did they agree upon?\n\nA:", ["\n"]], ["Discogs, short for discographies, is a website and crowdsourced database of information about audio recordings, including commercial releases, promotional releases, and bootleg or off-label releases. The Discogs servers, currently hosted under the domain name discogs.com, are owned by Zink Media, Inc., and are located in Portland, Oregon, US. While the site lists releases in all genres and on all formats, it is especially known as the largest online database of electronic music releases, and of releases on vinyl media. Discogs currently contains over 8 million releases, by nearly 4.9 million artists, across over 1 million labels, contributed from nearly 346,000 contributor user accounts\u2014with these figures constantly growing as users continually add previously unlisted releases to the site over time. \n\nThe discogs.com domain name was registered on 30 August 2000, and Discogs itself was launched in November 2000 by programmer, DJ, and music fan Kevin Lewandowski originally as a database of electronic music. \n\nHe was inspired by the success of community-built sites such as Slashdot, eBay, and Open Directory Project, and decided to use this model for a music discography database. \n\nThe site's original goal was to build the most comprehensive database of electronic music, organized around the artists, labels, and releases available in that genre. In 2003 the Discogs system was completely rewritten, and in January 2004 it began to support other genres, starting with hip hop. Since then, it has expanded to include rock and jazz in January 2005 and funk/soul, Latin, and reggae in October of the same year. In January 2006 blues and non-music (e.g. comedy records, field recordings, interviews) were added. Classical music started being supported in June 2007, and in October 2007 the \"final genres were turned on\" \u2013 adding support for the Stage & Screen, Brass & Military, Children's, and Folk, World, & Country music genres, allowing capture of virtually every single type of audio recording that has ever been released.\n\nQ: Who owns the websites servers?\n\nA: Zink Media, Inc\n\nQ: Where are they located?\n\nA: Portland,\n\nQ: When was the website registered?\n\nA: 30 August 2000\n\nQ: How many different releases are on the site?\n\nA: 8 million releases\n\nQ: artists?\n\nA: 4.9 million\n\nQ: labels?\n\nA: 1 million\n\nQ: Do they continue to catalogue more material?\n\nA: yes\n\nQ: Who started the website?\n\nA: Kevin Lewandowski\n\nQ: What were his inspirations?\n\nA: community-built sites\n\nQ: What type of music did the site originally focus on?\n\nA: electronic music\n\nQ: Has it since expanded beyond this particular type of music?\n\nA: yes\n\nQ: When did it start branching out into different genres?\n\nA: January 2004\n\nQ: What is the ultimate goal of the platform?\n\nA: to build the most comprehensive database of music\n\nQ: Is the information crowd sourced?\n\nA:", ["\n"]], ["CHAPTER VIII. BRUCE AND THE WAR OF INDEPENDENCE. \n\nThe position towards France of Edward I. made it really more desirable for him that Scotland should be independent and friendly, than half subdued and hostile to his rule. While she was hostile, England, in attacking France, always left an enemy in her rear. But Edward supposed that by clemency to all the Scottish leaders except Wallace, by giving them great appointments and trusting them fully, and by calling them to his Parliament in London, he could combine England and Scotland in affectionate union. He repaired the ruins of war in Scotland; he began to study her laws and customs; he hastily ran up for her a new constitution, and appointed his nephew, John of Brittany, as governor. But he had overlooked two facts: the Scottish clergy, from the highest to the lowest, were irreconcilably opposed to union with England; and the greatest and most warlike of the Scottish nobles, if not patriotic, were fickle and insatiably ambitious. It is hard to reckon how often Robert Bruce had turned his coat, and how often the Bishop of St Andrews had taken the oath to Edward. Both men were in Edward's favour in June 1304, but in that month they made against him a treasonable secret covenant. Through 1305 Bruce prospered in Edward's service, on February 10, 1306, Edward was conferring on him a new favour, little guessing that Bruce, after some negotiation with his old rival, the Red Comyn, had slain him (an uncle of his was also butchered) before the high altar of the Church of the Franciscans in Dumfries. Apparently Bruce had tried to enlist Comyn in his conspiracy, and had found him recalcitrant, or feared that he would be treacherous (February 10, 1306). \n\nQ: How did Edward I feel that Scotland should act?\n\nA: independent and friendly\n\nQ: as opposed to what?\n\nA: subdued and hostile\n\nQ: towards what?\n\nA: to his rule\n\nQ: who always left an enemy?\n\nA: England\n\nQ: when?\n\nA: in attacking France\n\nQ: How did Edward think it best to unite England and Scotland?\n\nA: in affectionate union\n\nQ: how did he attempt this?\n\nA: study her laws and customs\n\nQ: what else would he do?\n\nA: ran up for her a new constitution\n\nQ: did he also think great appointments and trust would help?\n\nA: yes\n\nQ: who did he decide to appoint?\n\nA: his nephew\n\nQ: as what?\n\nA: as governor\n\nQ: what was his name?\n\nA: John\n\nQ: where was he from?\n\nA: Brittany\n\nQ: what fact had he forgotten?\n\nA: some were opposed to this\n\nQ: opposed to what?\n\nA: union with England\n\nQ: who was opposed?\n\nA: Scottish clergy and nobles\n\nQ: Who betrayed Edward?\n\nA: Bishop of St Andrews\n\nQ: and who else?\n\nA: Robert Bruce\n\nQ: what did they do?\n\nA: treasonable secret covenant\n\nQ: when?\n\nA:", ["\n"]], ["(The Frisky) -- By T-minus 18 days until the Oscars and, of course, we are all starting to place bets on who we think will walk away with little golden men this year. Luckily, the Academy has proven itself to be pretty darn predictable over the years. If you're America's Sweetheart, you'll probably win Best Actress. If you sing in a flick, you are almost guaranteed Oscar gold. But there's another trend we've been noticing lately: the winners for Best Actress and Best Actor tend to be the person who's taken on the based-on-a-true-story role. In fact, 10 of the 20 top honors given in the 2000s went to actors who portrayed real people. Let's take a look, shall we? \n\nLast year, Sandra Bullock won Best Actress -- just days after taking home a Razzie -- for playing Leigh Anne Tuohy, the Southern mom who took in Michael Oher and helped coach him toward football greatness. The real Leigh Anne was in the theater to see Sandra accept her award. \n\nThe Frisky: 12 Female Celebs Reveal Their True Size \n\nIn 2008, Sean Penn won the Academy Award for Best Actor -- again! -- for playing Harvey Milk, the first openly gay man to be elected to public office in California. \n\nI still remember the gorgeous mermaid-scale gown that Marion Cotillard won when she accepted the Oscar for Best Actress in 2007 for her role in \"La Vie En Rose.\" In the movie, she played Edith Piaf, an extremely popular singer in France who was also known for her out-of-control social life. In many ways, Marion won for playing the Britney Spears of 1950s France. \n\nQ: What is becoming predictable?\n\nA: The Academy.\n\nQ: Who might just winn the best actress?\n\nA: America's Sweetheart.\n\nQ: What about singers?\n\nA: They are almost guaranteed Oscar gold.\n\nQ: Can a true story moive produce best performers?\n\nA: Yes.\n\nQ: Who got best actress last year?\n\nA: Sandra Bullock.\n\nQ: Did she get another one earlier?\n\nA: Yes.\n\nQ: in what character?\n\nA: Leigh Anne Tuohy.\n\nQ: What sports was in the storyline?\n\nA: Football.\n\nQ: What the real life charactere present there?\n\nA: Yes.\n\nQ: How many charecters were in the film?\n\nA: unknown\n\nQ: Who got the 2008 one?\n\nA: Sean Penn.\n\nQ: What was his character?\n\nA: Harvey Milk.\n\nQ: What was the man's sexual orientation?\n\nA: Gay.\n\nQ: Did he come out?\n\nA: Yes.\n\nQ: What was his other accomplishment?\n\nA: He was elected to public office.\n\nQ: In which state?\n\nA: California.\n\nQ: Who got the 2007 one?\n\nA: Marion Cotillard.\n\nQ: What was the film?\n\nA: La Vie En Rose.\n\nQ: What was here character?\n\nA: Edith Piaf.\n\nQ: Who was she?\n\nA: A singer.\n\nQ: Where?\n\nA: France.\n\nQ: Whs she bit unruly?\n\nA:", ["\n"]], ["(CNN) -- A body discovered at Churchill Downs on Sunday, a day after the storied Louisville racetrack hosted the Kentucky Derby, may have been the victim of a homicide, police said. \n\nWorkers in the barn area discovered the body early in the morning and notified track security, which called police, said Robert Biven, a spokesman for the Louisville Metropolitan Police Department. \n\n\"We just got the call just prior to 5 a.m. to respond to the backside\" of the racetrack, Biven told CNN. \n\nPolice spokeswoman Alicia Smiley said police suspect foul play. \n\nThe body, which has not been identified, appears to be a Latino man in his 30s or 40s, Biven said. \n\nAbout 400 people were located Saturday night in the rear of the racetrack, he said. \"So we are trying to speak with as many people as we possibly can,\" he said. \"We do have a few leads coming in.\" An autopsy is to be carried out Monday morning. \n\nBiven described the track's backside as \"like a mini city,\" with 48 barns, workers' dormitories and areas where trainers live. \"It's a 24-hour operation,\" he said. \n\nI'll Have Another wins Kentucky Derby \n\nOperations at the racetrack were to continue normally on Sunday, Churchill Downs spokesman John Asher said. No races are scheduled at the track for three days, but cleanup from Saturday's race was to continue and the racetrack museum was to be open, he said. \n\nCNN's Kara Devlin and Christine Sever contributed to this report \n\n\n\nQ: What time of day did workers locate the body?\n\nA: early in the morning\n\nQ: Whom did they contact about it?\n\nA: track security\n\nQ: And whom did they call?\n\nA: police\n\nQ: Who is Robert Biven?\n\nA: a spokesman for the Louisville Metropolitan Police Department\n\nQ: On what day was the body found?\n\nA: on Sunday\n\nQ: Where?\n\nA: at Churchill Downs\n\nQ: Is that a racetrack?\n\nA: Yes\n\nQ: In what city?\n\nA: Louisville\n\nQ: What event had the track hosted the day before?\n\nA: the Kentucky Derby\n\nQ: What news outlet did Biven speak with?\n\nA: CNN\n\nQ: What side of the track did he say they went to?\n\nA: the backside\n\nQ: When did they receive a call about the body?\n\nA: just prior to 5 a.m.\n\nQ: Who is the police spokesperson?\n\nA: Alicia Smiley\n\nQ: Is the racetrack in operation 24 hours a day?\n\nA: Yes\n\nQ: Who is John Asher?\n\nA: Churchill Downs spokesman\n\nQ: For how many days are no races scheduled at the track?\n\nA: three\n\nQ: Was the museum to remain open?\n\nA: Yes\n\nQ: What was the age of the person found dead?\n\nA: 30s or 40s\n\nQ: What is his racial background?\n\nA: a Latino man\n\nQ: When will the autopsy take place?\n\nA:", ["\n"]], ["When my father was dying, I traveled a thousand miles from home to be with him in his last days. It was far more heartbreaking than I'd expected, one of the most difficult and painful times in my life. After he passed away I stayed alone in his apartment. There were so many things to deal with. It all seemed endless. I was lonely. I hated the silence of the apartment. \n\nBut one evening the silence was broken: I heard crying outside. I opened the door to find a little cat on the steps. He was thin and poor. He looked the way I felt. I brought him inside and gave him a can of fish. He ate it and then almost immediately fell sound asleep. \n\nThe next morning I checked with neighbors and learned that the cat had been abandoned by his owner who's moved out. So the little cat was there all alone, just like I was. As I walked back to the apartment, I tried to figure out what to do with him. Having something else to take care of seemed _ But as soon as I opened the apartment door he came running and jumped into my arms. It was clear from that moment that he had no intention of going anywhere. I started calling him Willis, in honor of my father's best friend. \n\nFrom then on, things grew easier. With Willis in my lap time seemed to pass much more quickly. When the time finally came for me to return home I had to decide what to do about Willis. There was absolutely no way I would leave without him. \n\nIt's now been five years since my father died. Over the years, several people have commented on how nice it was of me to rescue the cat. But I know that we rescued each other. I may have given him a home but he gave me something greater.\n\nQ: What was crying?\n\nA: a cat\n\nQ: what did the author feed it?\n\nA: yes\n\nQ: what did the author feed it?\n\nA: fish\n\nQ: then what did the cat do?\n\nA: fell asleep\n\nQ: where was the author?\n\nA: his father's apartment.\n\nQ: was the father alive by then?\n\nA: no\n\nQ: how far did the author travel?\n\nA: a thousand miles\n\nQ: who did the author check about the cat with?\n\nA: neighbors\n\nQ: what did he find out?\n\nA: the cat was abandoned\n\nQ: by who?\n\nA: his owner\n\nQ: what did he call him?\n\nA: Willis\n\nQ: how long has he had him?\n\nA: five years\n\nQ: who was he named after?\n\nA: his father's best friend.\n\nQ: did the author go without him?\n\nA: no\n\nQ: how did the author feel after his dad died?\n\nA: heartbroken\n\nQ: did he expect it?\n\nA: no\n\nQ: what did people say to him about Willis?\n\nA: it was nice to rescue him\n\nQ: did he feel the same?\n\nA: no\n\nQ: what did he feel?\n\nA: they rescued each other\n\nQ: did he originally want to keep Willis?\n\nA:", ["\n"]], ["David and Lucy waited in their mom's truck. They all were going to the circus to see the clowns. Their Mom had to take their little brother back into the house to get more diapers and go to the bathroom. David was worried because he did not want to miss the wolf clown. Lucy watched her brother rub his chin. \"Why are you looking out the window?\" she asked. \"Mom needs to hurry. We might miss the clowns.\" \"I am going to get out of the truck and draw triangles in the sand.\" Lucy said. \"No! You might make us miss it.\" David cried. Before she could get out of the truck Lucy saw her mom and little brother walk out of the house. Her mom got in the truck and asked, \"Okay kids are we ready to go?\" David and Lucy yelled, \"Yes!\" When they got to the circus David and Lucy saw all the clowns. Their little brother was too young to go into the tent, so their mom stayed with him. The show ended and they walked to the truck. \"What do you have there?\" David asked Lucy \"It is a bag I found in the tent.\" Lucy said. \"We have to return that Lucy.\" Their mom said. \"Why? It has cool stuff in it. I found it.\" Lucy said. \"It is not ours.\" Their mom said. Lucy frowned as they walked to the lost and found and gave the bag back. Then they all went home. When they were washing up to go to bed Lucy said, \"I fear some of those clowns. The wolf one was scary.\" \"Lucy, I can save you. The wolf clown was a person in make-up.\" With that they shut off the bathroom light and went to bed. A great day had by all.\n\nQ: What did Lucy find in the tent?\n\nA: unknown\n\nQ: What was in it?\n\nA: cool stuff\n\nQ: Who was in the truck?\n\nA: David and Lucy\n\nQ: why?\n\nA: They were going to the circus\n\nQ: Who's trruck was it?\n\nA: their mom's\n\nQ: was she there?\n\nA: No\n\nQ: why not?\n\nA: She had to take their brother to the house\n\nQ: why?\n\nA: to get diapers and go to the bathroom\n\nQ: Did Lucy get out of the truck?\n\nA: No\n\nQ: Did she want to?\n\nA:", ["\n"]]]
\ No newline at end of file
{"results": {"coqa": {"f1": 0.0, "f1_stderr": 0.0, "em": 0.0, "em_stderr": 0.0}}, "versions": {"coqa": 0}}
\ No newline at end of file
{"results": {"coqa": {"em": 0.0, "em_stderr": 0.0, "f1": 0.0, "f1_stderr": 0.0}}, "versions": {"coqa": 0}}
\ No newline at end of file
eb23f7d5de7528eefd8ed5f8054c402ff947319cccfef7195995946f99389201
\ No newline at end of file
[["\ndenforbid =", ["\n"]], ["\nourismt =", ["\n"]], ["\nublestro =", ["\n"]], ["\nrtersheadqua =", ["\n"]], ["\neaseincr =", ["\n"]], ["\nsmetric =", ["\n"]], ["\ntlettbar =", ["\n"]], ["\nisheryf =", ["\n"]], ["\nationliber =", ["\n"]], ["\nameworksfr =", ["\n"]]]
\ No newline at end of file
ca566c630d8ac853d5785d4b5c40a5137172c34b48af3350e1f79e6d548b36ba
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment