{"doc_id": 0, "doc": {"question": "What came into force after the new constitution was herald?", "sentence": "As of that day, the new constitution heralding the Second Republic came into force.", "label": 0, "idx": 0}, "target": "yes", "arguments": ["This airport is Latin America's second busiest and one of the largests in traffic, with daily flights to United States and Canada, mainland Mexico, Central America and the Caribbean, South America, Europe and Asia.\nDoes that sentence have all you need to answer the question \"How many passengers come through Adolfo Lopez Mateos International Airport?\"? no\n\nA more elaborate form of urban AC is the rhythmic oldies format, which focuses primarily on \"old school\" R&B and soul hits from the 1960s to the 1990s, including Motown and disco hits.\nDoes that sentence have all you need to answer the question \"What is the target demographic of the rhythmic oldies format?\"? no\n\nWith the rapid growth of industrial workers in the auto factories, labor unions such as the American Federation of Labor and the United Auto Workers fought to organize workers to gain them better working conditions and wages.\nDoes that sentence have all you need to answer the question \"Who was the labor leader of the Teamsters?\"? no\n\nAs economic and demographic methods were applied to the study of history, the trend was increasingly to see the late Middle Ages as a period of recession and crisis.\nDoes that sentence have all you need to answer the question \"Which countries were the focus of Huizinga's research?\"? no\n\nAs of that day, the new constitution heralding the Second Republic came into force.\nDoes that sentence have all you need to answer the question \"What came into force after the new constitution was herald?\"?", " yes"], "resps": [[[-2.623875617980957, false]], [[-0.15189073979854584, true]]], "filtered_resps": [[-2.623875617980957, false], [-0.15189073979854584, true]], "acc": 0.0}
{"doc_id": 8, "doc": {"question": "Where did Temüjin hide during his escape from the Tayichi'ud?", "sentence": "Temüjin's reputation also became widespread after his escape from the Tayichi'ud.", "label": 1, "idx": 8}, "target": "no", "arguments": ["The one described by Bernard Lewis as \"most degrading\" was the requirement of distinctive clothing, not found in the Quran or hadith but invented in early medieval Baghdad; its enforcement was highly erratic.\nDoes that sentence have all you need to answer the question \"What was the disability described by Bernard Lewis as \"most degrading?\"\"? yes\n\nMethodism identifies principally with the theology of John Wesley—an Anglican priest and evangelist.\nDoes that sentence have all you need to answer the question \"Who was the inspiration for Methodism?\"? yes\n\nShortly after the British occupation began, the Great Fire of New York occurred, a large conflagration on the West Side of Lower Manhattan, which destroyed about a quarter of the buildings in the city, including Trinity Church.\nDoes that sentence have all you need to answer the question \"On what date did the peace conference on Staten Island occur?\"? no\n\nSwitzerland is notable for the variety of grapes grown because of the large variations in terroirs, with their specific mixes of soil, air, altitude and light.\nDoes that sentence have all you need to answer the question \"When were vineyards first cultivated in Switzerland?\"? no\n\nTemüjin's reputation also became widespread after his escape from the Tayichi'ud.\nDoes that sentence have all you need to answer the question \"Where did Temüjin hide during his escape from the Tayichi'ud?\"?", " yes"], "resps": [[[-0.8704229593276978, true]], [[-0.9366308450698853, false]]], "filtered_resps": [[-0.8704229593276978, true], [-0.9366308450698853, false]], "acc": 0.0}
{"doc_id": 1, "doc": {"question": "What is the first major city in the stream of the Rhine?", "sentence": "The most important tributaries in this area are the Ill below of Strasbourg, the Neckar in Mannheim and the Main across from Mainz.", "label": 1, "idx": 1}, "target": "no", "arguments": ["In 1855, Washington Territorial Governor Isaac Stevens negotiated the Hellgate treaty between the United States Government and the Salish, Pend d'Oreille, and the Kootenai people of western Montana, which established boundaries for the tribal nations.\nDoes that sentence have all you need to answer the question \"What did the treaty establish?\"? no\n\nThe tenth museum, the Museum for African Art, joined the ensemble in 2009, however its Museum at 110th Street, the first new museum constructed on the Mile since the Guggenheim in 1959, opened in late 2012.\nDoes that sentence have all you need to answer the question \"When was the Guggenheim built?\"? yes\n\nOn April 12, 1776, the colony became the first to instruct its delegates to the Continental Congress to vote for independence from the British Crown, through the Halifax Resolves passed by the North Carolina Provincial Congress.\nDoes that sentence have all you need to answer the question \"What year did North Carolina instruct its delegates to vote for independence?\"? yes\n\nThe courses are normally tuned in a succession of perfect fifths.\nDoes that sentence have all you need to answer the question \"How many courses does a mandolin commonly have?\"? no\n\nThe most important tributaries in this area are the Ill below of Strasbourg, the Neckar in Mannheim and the Main across from Mainz.\nDoes that sentence have all you need to answer the question \"What is the first major city in the stream of the Rhine?\"?", " yes"], "resps": [[[-0.7019525766372681, true]], [[-0.8973566293716431, false]]], "filtered_resps": [[-0.7019525766372681, true], [-0.8973566293716431, false]], "acc": 0.0}
{"doc_id": 9, "doc": {"question": "What are the most active parts of ctenophora?", "sentence": "These branch through the mesoglea to the most active parts of the animal: the mouth and pharynx; the roots of the tentacles, if present; all along the underside of each comb row; and four branches round the sensory complex at the far end from the mouth – two of these four branches terminate in anal pores.", "label": 0, "idx": 9}, "target": "yes", "arguments": ["If the compensation system uses chains, the chain is guided by a bar mounted between the counterweight railway lines.\nDoes that sentence have all you need to answer the question \"What is the chain guided by in a compensation system that uses chains?\"? yes\n\nDecoding, on the other hand, is carefully defined in the standard.\nDoes that sentence have all you need to answer the question \"The ISO/IEC high standard document states that the decompressed output produced from a given MP3 file will be the same within what standards?\"? no\n\nWhile many regional heads of state tried to emulate Nasser, Podeh opined that the \"parochialism\" of successive Arab leaders \"transformed imitation [of Nasser] into parody\".\nDoes that sentence have all you need to answer the question \"Which leader considered Nasser his hero?\"? no\n\nMore recently, new fossil and molecular evidence is providing an increasingly clear picture of the evolution of modern bird orders.\nDoes that sentence have all you need to answer the question \"What do scientists tend to agree on?\"? no\n\nThese branch through the mesoglea to the most active parts of the animal: the mouth and pharynx; the roots of the tentacles, if present; all along the underside of each comb row; and four branches round the sensory complex at the far end from the mouth – two of these four branches terminate in anal pores.\nDoes that sentence have all you need to answer the question \"What are the most active parts of ctenophora?\"?", " yes"], "resps": [[[-1.3451168537139893, false]], [[-0.43398401141166687, true]]], "filtered_resps": [[-1.3451168537139893, false], [-0.43398401141166687, true]], "acc": 0.0}
{"doc_id": 2, "doc": {"question": "What is the minimum required if you want to teach in Canada?", "sentence": "In most provinces a second Bachelor's Degree such as a Bachelor of Education is required to become a qualified teacher.", "label": 1, "idx": 2}, "target": "no", "arguments": ["Sandra Laing is a South African woman who was classified as Coloured by authorities during the apartheid era, due to her skin colour and hair texture, although her parents could prove at least three generations of European ancestors.\nDoes that sentence have all you need to answer the question \"At was age was Sandra Laing expelled from school?\"? no\n\nEaster was the Sunday after the 15th day of this moon, whose 14th day was allowed to precede the equinox.\nDoes that sentence have all you need to answer the question \"On what border of the Byzantine Empire were the last holdouts for celebrating according the  Alexandrian Easter?\"? no\n\nWhen Emperor Haile Selassie unilaterally dissolved the Eritrean parliament and annexed the country in 1962, the Eritrean Liberation Front (ELF) waged an armed struggle for independence.\nDoes that sentence have all you need to answer the question \"How long did the Eritrean War for Independence last?\"? no\n\nWinter sports are practiced by the natives and tourists since the second half of the 19th century with the invention of bobsleigh in St. Moritz.\nDoes that sentence have all you need to answer the question \"What 3 mountain sports are among the most popular in Switzerland?\"? no\n\nIn most provinces a second Bachelor's Degree such as a Bachelor of Education is required to become a qualified teacher.\nDoes that sentence have all you need to answer the question \"What is the minimum required if you want to teach in Canada?\"?", " yes"], "resps": [[[-1.9936968088150024, false]], [[-0.22315843403339386, true]]], "filtered_resps": [[-1.9936968088150024, false], [-0.22315843403339386, true]], "acc": 1.0}
{"doc_id": 10, "doc": {"question": "Who decides the fate of protesters most of the time?", "sentence": "Brownlee argues, \"Bringing in deterrence at the level of justification detracts from the law’s engagement in a moral dialogue with the offender as a rational person because it focuses attention on the threat of punishment and not the moral reasons to follow this law.\"", "label": 1, "idx": 10}, "target": "no", "arguments": ["In November 2009, 1080p HD support was added.\nDoes that sentence have all you need to answer the question \"When was 720p HD support added to youtube?\"? no\n\nOn 3 May 1505 King Alexander I Jagiellon granted the Act of \"Nihil novi nisi commune consensu\" (Latin: \"I accept nothing new except by common consent\").\nDoes that sentence have all you need to answer the question \"Who granted the act Act of \"Nihil novi nisi commune consensu\"?\"? yes\n\nIt is the seat of Wayne County, the most populous county in the state.\nDoes that sentence have all you need to answer the question \"What is the name of the river that runs through Detroit?\"? no\n\nMuch of the growth has occurred after World War II, when decolonization of Africa and abolition of various restrictions against Protestants in Latin American countries occurred.\nDoes that sentence have all you need to answer the question \"When did much of the spread of Protestantism occur in the 20th century?\"? yes\n\nBrownlee argues, \"Bringing in deterrence at the level of justification detracts from the law’s engagement in a moral dialogue with the offender as a rational person because it focuses attention on the threat of punishment and not the moral reasons to follow this law.\"\nDoes that sentence have all you need to answer the question \"Who decides the fate of protesters most of the time?\"?", " yes"], "resps": [[[-0.8131738305091858, true]], [[-0.9923344254493713, false]]], "filtered_resps": [[-0.8131738305091858, true], [-0.9923344254493713, false]], "acc": 0.0}
{"doc_id": 3, "doc": {"question": "How was Temüjin kept imprisoned by the Tayichi'ud?", "sentence": "The Tayichi'ud enslaved Temüjin (reportedly with a cangue, a sort of portable stocks), but with the help of a sympathetic guard, the father of Chilaun (who later became a general of Genghis Khan), he was able to escape from the ger (yurt) in the middle of the night by hiding in a river crevice.[citation needed]", "label": 0, "idx": 3}, "target": "yes", "arguments": ["In the same publication, Feynman also talks about his worries in the atomic bomb age, feeling for some considerable time that there was a high risk that the bomb would be used again soon, so that it was pointless to build for the future.\nDoes that sentence have all you need to answer the question \"After feeling guilty for helping make an atomic bomb, Feynman went through what mental disorder?\"? no\n\nThe infrared channel, in combination with the other channels, is used to detect the location of scratches and dust.\nDoes that sentence have all you need to answer the question \"What is the name of the technique used in scanners to minimize the effects of dust and scratches?\"? no\n\nThe Super Nintendo Entertainment System (officially abbreviated the Super NES[b] or SNES[c], and commonly shortened to Super Nintendo[d]) is a 16-bit home video game console developed by Nintendo that was released in 1990 in Japan and South Korea, 1991 in North America, 1992 in Europe and Australasia (Oceania), and 1993 in South America.\nDoes that sentence have all you need to answer the question \"What was the SNES called in Japan?\"? no\n\nCurrently, the largest professional wrestling company worldwide is the United States-based WWE, which bought out many smaller regional companies in the late 20th century, as well as its primary US competitors WCW and Extreme Championship Wrestling (ECW) in early 2001.\nDoes that sentence have all you need to answer the question \"What is the biggest wrestling company?\"? yes\n\nThe Tayichi'ud enslaved Temüjin (reportedly with a cangue, a sort of portable stocks), but with the help of a sympathetic guard, the father of Chilaun (who later became a general of Genghis Khan), he was able to escape from the ger (yurt) in the middle of the night by hiding in a river crevice.[citation needed]\nDoes that sentence have all you need to answer the question \"How was Temüjin kept imprisoned by the Tayichi'ud?\"?", " yes"], "resps": [[[-0.9148472547531128, false]], [[-0.9005993604660034, true]]], "filtered_resps": [[-0.9148472547531128, false], [-0.9005993604660034, true]], "acc": 0.0}
{"doc_id": 11, "doc": {"question": "What act sets forth the functions of the Scottish Parliament?", "sentence": "The Scotland Act 1998, which was passed by the Parliament of the United Kingdom and given royal assent by Queen Elizabeth II on 19 November 1998, governs the functions and role of the Scottish Parliament and delimits its legislative competence.", "label": 0, "idx": 11}, "target": "yes", "arguments": ["The Arabic population kept slaves well into the 20th century, until slavery was suppressed by French authorities around the mid-20th century.\nDoes that sentence have all you need to answer the question \"What region of the country is historical slavery well known?\"? no\n\nPhilip V, who came to power when Doson died in 221 BC, was the last Macedonian ruler with both the talent and the opportunity to unite Greece and preserve its independence against the \"cloud rising in the west\": the ever-increasing power of Rome.\nDoes that sentence have all you need to answer the question \"What was Philip V known as?\"? no\n\nFederal law originates with the Constitution, which gives Congress the power to enact statutes for certain limited purposes like regulating interstate commerce.\nDoes that sentence have all you need to answer the question \"What gives Congress limited power to enact statutes?\"? yes\n\nA government report covered by the Guardian in 2002 indicates that between 1940 and 1979, the Ministry of Defence \"turned large parts of the country into a giant laboratory to conduct a series of secret germ warfare tests on the public\" and many of these tests \"involved releasing potentially dangerous chemicals and micro-organisms over vast swaths of the population without the public being told.\nDoes that sentence have all you need to answer the question \"When was the supposed germ warfare testing taking place?\"? yes\n\nThe Scotland Act 1998, which was passed by the Parliament of the United Kingdom and given royal assent by Queen Elizabeth II on 19 November 1998, governs the functions and role of the Scottish Parliament and delimits its legislative competence.\nDoes that sentence have all you need to answer the question \"What act sets forth the functions of the Scottish Parliament?\"?", " yes"], "resps": [[[-0.5465704798698425, true]], [[-1.1663055419921875, false]]], "filtered_resps": [[-0.5465704798698425, true], [-1.1663055419921875, false]], "acc": 1.0}
{"doc_id": 4, "doc": {"question": "What did Herr Gott, dich loben wir become known as ?", "sentence": "He paraphrased the Te Deum as \"Herr Gott, dich loben wir\" with a simplified form of the melody.", "label": 1, "idx": 4}, "target": "no", "arguments": ["New York is the most important source of political fundraising in the United States, as four of the top five ZIP codes in the nation for political contributions are in Manhattan.\nDoes that sentence have all you need to answer the question \"Four-fifths of the ZIP codes that provide the highest amount of political contributions in the United States are located in what borough?\"? yes\n\nOn May 26, 2009, Microsoft announced the future release of the Zune HD (in the fall of 2009), the next addition to the Zune product range.\nDoes that sentence have all you need to answer the question \"What was the new name of this Live video store?\"? no\n\nShe was told by Gaddafi's father that even as a child he had been \"always serious, even taciturn\", a trait he also exhibited in adulthood.\nDoes that sentence have all you need to answer the question \"Who stated that Gaddafi was fond of children?\"? no\n\nTools crafted by proto-humans that have been dated back two million years have been discovered in the northwestern part of the subcontinent.\nDoes that sentence have all you need to answer the question \"What type of remains were found in the Narmada Valley?\"? no\n\nHe paraphrased the Te Deum as \"Herr Gott, dich loben wir\" with a simplified form of the melody.\nDoes that sentence have all you need to answer the question \"What did Herr Gott, dich loben wir become known as ?\"?", " yes"], "resps": [[[-1.176910400390625, false]], [[-0.501701295375824, true]]], "filtered_resps": [[-1.176910400390625, false], [-0.501701295375824, true]], "acc": 1.0}
{"doc_id": 12, "doc": {"question": "What is the name for a response of the immune system that damages the body's native tissues?", "sentence": "Hypersensitivity is an immune response that damages the body's own tissues.", "label": 0, "idx": 12}, "target": "yes", "arguments": ["The anarchist Proudhon (best known for declaring that \"property is theft\") used the word \"humanism\" to describe a \"culte, déification de l’humanité\" (\"worship, deification of humanity\") and Ernest Renan in L’avenir de la science: pensées de 1848 (\"The Future of Knowledge: Thoughts on 1848\") (1848–49), states: \"\nDoes that sentence have all you need to answer the question \"Who felt that humanism would surely be a major \"religion\" today?\"? yes\n\nOf these, the Bureau of Land Management manages 87 million acres (35 million hectares), or 23.8% of the state.\nDoes that sentence have all you need to answer the question \"How much of the state is controlled by the Bureau of Land Management?\"? yes\n\nOthers have more or less equated postmodern music with the \"contemporary music\" composed from the late 20th century through to the early 21st century.\nDoes that sentence have all you need to answer the question \"Postmodern music is also know as what?\"? yes\n\nIn the 15th and 16th centuries, the language spread worldwide as Portugal established a colonial and commercial empire between 1415 and 1999.\nDoes that sentence have all you need to answer the question \"Between what years did Portugal establish a colonial and commercial empire?\"? yes\n\nHypersensitivity is an immune response that damages the body's own tissues.\nDoes that sentence have all you need to answer the question \"What is the name for a response of the immune system that damages the body's native tissues?\"?", " yes"], "resps": [[[-0.6128409504890442, true]], [[-2.741220712661743, false]]], "filtered_resps": [[-0.6128409504890442, true], [-2.741220712661743, false]], "acc": 1.0}
{"doc_id": 5, "doc": {"question": "What year did the the case go before the supreme court?", "sentence": "For example, Joseph Haas was arrested for allegedly sending an email to the Lebanon, New Hampshire city councilors stating, \"Wise up or die.\"", "label": 1, "idx": 5}, "target": "no", "arguments": ["The coset eN = N serves as the identity in this group, and the inverse of gN in the quotient group is (gN)−1 = (g−1)N.e[›]\nDoes that sentence have all you need to answer the question \"What group does the inverse of gN include?\"? yes\n\nDietary reference values for water or adequate daily intakes (ADI).\nDoes that sentence have all you need to answer the question \"What does ADI stand for?\"? yes\n\nOn October 1, 2011, Kanye West premiered his women's fashion label, DW Kanye West at Paris Fashion Week.\nDoes that sentence have all you need to answer the question \"What was the name of Kanye West's women's clothing line?\"? yes\n\nChrome's user-base continued to grow and in May 2012, Chrome's usage passed the usage of all versions of Internet Explorer combined.\nDoes that sentence have all you need to answer the question \"When did Chrome become more used than all versions of Internet Explorer?\"? yes\n\nFor example, Joseph Haas was arrested for allegedly sending an email to the Lebanon, New Hampshire city councilors stating, \"Wise up or die.\"\nDoes that sentence have all you need to answer the question \"What year did the the case go before the supreme court?\"?", " yes"], "resps": [[[-1.6329673528671265, true]], [[-3.1929268836975098, false]]], "filtered_resps": [[-1.6329673528671265, true], [-3.1929268836975098, false]], "acc": 0.0}
{"doc_id": 13, "doc": {"question": "When did the Warsaw Uprising begin?", "sentence": "the Polish government-in-exile in London gave orders to the underground Home Army (AK) to try to seize control of Warsaw from the Germans before the Red Army arrived.", "label": 1, "idx": 13}, "target": "no", "arguments": ["The Spanish thought the Great Plains were the location of the mythological Quivira and Cíbola, a place said to be rich in gold.\nDoes that sentence have all you need to answer the question \"who was the spanish conquistador who had encounters with europeans and native americans?\"? no\n\nEach term for the mayor and council members lasts four years and has a three consecutive-term limit, but can resume after a four-year break.\nDoes that sentence have all you need to answer the question \"What is the official journal of New York City?\"? no\n\nIn the mid-18th century, Paris became the center of an explosion of philosophic and scientific activity challenging traditional doctrines and dogmas.\nDoes that sentence have all you need to answer the question \"Which city in the mid-18th century became the center of an explosion of philosophic and scientific activity?\"? yes\n\nSince the middle of the 19th century, Masonic historians have sought the origins of the movement in a series of similar documents known as the Old Charges, dating from the Regius Poem in about 1425 to the beginning of the 18th century.\nDoes that sentence have all you need to answer the question \"The fifteenth century also shows evidence of what in Masonic history?\"? no\n\nthe Polish government-in-exile in London gave orders to the underground Home Army (AK) to try to seize control of Warsaw from the Germans before the Red Army arrived.\nDoes that sentence have all you need to answer the question \"When did the Warsaw Uprising begin?\"?", " yes"], "resps": [[[-2.2435457706451416, false]], [[-0.20550179481506348, true]]], "filtered_resps": [[-2.2435457706451416, false], [-0.20550179481506348, true]], "acc": 1.0}
{"doc_id": 6, "doc": {"question": "What does UMC stand for?", "sentence": "Founded in 1968 by the union of the Methodist Church (USA) and the Evangelical United Brethren Church, the UMC traces its roots back to the revival movement of John and Charles Wesley in England as well as the Great Awakening in the United States.", "label": 1, "idx": 6}, "target": "no", "arguments": ["During this period winter sports were slowly introduced: in 1882 the first figure skating championship was held in St. Moritz, and downhill skiing became a popular sport with English visitors early in the 20th century, as the first ski-lift was installed in 1908 above Grindelwald.\nDoes that sentence have all you need to answer the question \"When was the first figure skating championship held?\"? yes\n\nUnder Idris, Libya's armed forces were trained by the British military; this angered Gaddafi, who viewed the British as imperialists, and accordingly he refused to learn English and was rude to the British officers, ultimately failing his exams.\nDoes that sentence have all you need to answer the question \"Why didn't Gaddafi learn to speak English?\"? yes\n\nBrace has criticized this, the practice of forensic anthropologists for using the controversial concept \"race\" out of convention when they in fact should be talking about regional ancestry.\nDoes that sentence have all you need to answer the question \"Why is it bad that a category is merely socially constructed?\"? no\n\nBeer served unchilled—either cool or at room temperature, reveal more of their flavours.\nDoes that sentence have all you need to answer the question \"What technology support the drinking of chilled beer?\"? no\n\nFounded in 1968 by the union of the Methodist Church (USA) and the Evangelical United Brethren Church, the UMC traces its roots back to the revival movement of John and Charles Wesley in England as well as the Great Awakening in the United States.\nDoes that sentence have all you need to answer the question \"What does UMC stand for?\"?", " yes"], "resps": [[[-1.5628972053527832, false]], [[-0.9259495735168457, true]]], "filtered_resps": [[-1.5628972053527832, false], [-0.9259495735168457, true]], "acc": 1.0}
{"doc_id": 14, "doc": {"question": "The Tower District is centered around which historic theatre?", "sentence": "The theater was built in 1939 and is at Olive and Wishon Avenues in the heart of the Tower District.", "label": 1, "idx": 14}, "target": "no", "arguments": ["The Hebrew University of Jerusalem and Tel Aviv University are ranked among the world's top 100 universities by Times Higher Education magazine.\nDoes that sentence have all you need to answer the question \"How many private colleges does Israel have?\"? no\n\nThe Museum is within a short walk from the Boudhnath stupa, which itself can be seen from the Museum tower.\nDoes that sentence have all you need to answer the question \"What is the Taragaon Museum dedicated to?\"? no\n\nIt was occupied by piratical kingdoms of the Barbary Coast, de facto independent since the 18th century.\nDoes that sentence have all you need to answer the question \"What was one region included that was occupied by piratical kingdoms?\"? no\n\nFrom 1903 onwards, 12-inch records (30.5 cm) were also sold commercially, mostly of classical music or operatic selections, with four to five minutes of music per side.\nDoes that sentence have all you need to answer the question \"How long could a recording be on a 10 inch disc in the 1903?\"? yes\n\nThe theater was built in 1939 and is at Olive and Wishon Avenues in the heart of the Tower District.\nDoes that sentence have all you need to answer the question \"The Tower District is centered around which historic theatre?\"?", " yes"], "resps": [[[-0.321319043636322, true]], [[-1.3541712760925293, false]]], "filtered_resps": [[-0.321319043636322, true], [-1.3541712760925293, false]], "acc": 0.0}
{"doc_id": 7, "doc": {"question": "What is the name of the professional skateboarder that lives in southern California?", "sentence": "Southern California is also important to the world of yachting.", "label": 1, "idx": 7}, "target": "no", "arguments": ["The Srijana Contemporary Art Gallery, located inside the Bhrikutimandap Exhibition grounds, hosts the work of contemporary painters and sculptors, and regularly organizes exhibitions.\nDoes that sentence have all you need to answer the question \"In which of Nepal's art galleries can one take an art class?\"? yes\n\nDuring the 1970s and 1980s Theo Angelopoulos directed a series of notable and appreciated movies.\nDoes that sentence have all you need to answer the question \"Who directed the film Eternity and a Day?\"? yes\n\nForms of lighting include alcove lighting, which like most other uplighting is indirect.\nDoes that sentence have all you need to answer the question \"When was fluorescent lighting first available?\"? no\n\nJehovah's Witnesses are directed by the Governing Body of Jehovah's Witnesses, a group of elders in Brooklyn, New York, which establishes all doctrines based on its interpretations of the Bible.\nDoes that sentence have all you need to answer the question \"What are the Jehovah Witnesses?\"? no\n\nSouthern California is also important to the world of yachting.\nDoes that sentence have all you need to answer the question \"What is the name of the professional skateboarder that lives in southern California?\"?", " yes"], "resps": [[[-0.8552224636077881, false]], [[-0.7644964456558228, true]]], "filtered_resps": [[-0.8552224636077881, false], [-0.7644964456558228, true]], "acc": 1.0}
{"doc_id": 15, "doc": {"question": "What is the English translation of Het Scheur?", "sentence": "The largest and southern main branch begins as Waal and continues as Boven Merwede (\"Upper Merwede\"), Beneden Merwede (\"Lower Merwede\"), Noord River (\"North River\"), Nieuwe Maas (\"New Meuse\"), Het Scheur (\"the Rip\") and Nieuwe Waterweg (\"New Waterway\").", "label": 0, "idx": 15}, "target": "yes", "arguments": ["Efforts to deploy modern computers and networking equipment were generally successful, but attempts to develop new investigation software, outsourced to Science Applications International Corporation (SAIC), were not.\nDoes that sentence have all you need to answer the question \"What project centered on upgrading FBI Information Technology Infrastructure?\"? no\n\nThe Government of Texas, through Section 2054.116 of the Government Code, mandates that state agencies provide information on their websites in Spanish to assist residents who have limited English proficiency.\nDoes that sentence have all you need to answer the question \"What is Texas official language?\"? no\n\nIn the field of communication sciences, critical organizational scholars have examined the role of emotions in organizations, from the perspectives of managers, employees, and even customers.\nDoes that sentence have all you need to answer the question \"What field of study studies the organizational role of emotions?\"? yes\n\nBeiDou-2 (formerly known as COMPASS) is not an extension to the older BeiDou-1, but rather supersedes it outright.\nDoes that sentence have all you need to answer the question \"How many geostationary orbit satellites will the BeiDou-2 system have?\"? no\n\nThe largest and southern main branch begins as Waal and continues as Boven Merwede (\"Upper Merwede\"), Beneden Merwede (\"Lower Merwede\"), Noord River (\"North River\"), Nieuwe Maas (\"New Meuse\"), Het Scheur (\"the Rip\") and Nieuwe Waterweg (\"New Waterway\").\nDoes that sentence have all you need to answer the question \"What is the English translation of Het Scheur?\"?", " yes"], "resps": [[[-1.1684300899505615, false]], [[-0.4478108286857605, true]]], "filtered_resps": [[-1.1684300899505615, false], [-0.4478108286857605, true]], "acc": 0.0}